-- Logs begin at Fri 2022-08-12 05:58:14 UTC, end at Fri 2022-08-12 07:07:42 UTC. -- Aug 12 06:39:30.048431 dv-cinder-844572-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 12 06:39:30.057258 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 06:39:30 2022] *** Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: nodename: dv-cinder-844572-2-iscsi Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: machine: x86_64 Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: clock source: unix Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: pcre jit disabled Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: detected number of CPU cores: 4 Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: current working directory: / Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: detected binary path: /usr/bin/uwsgi-core Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: your processes number limit is 47680 Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: your memory page size is 4096 bytes Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: detected max file descriptor number: 2048 Aug 12 06:39:30.059320 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: lock engine: pthread robust mutexes Aug 12 06:39:30.060261 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: thunder lock: enabled Aug 12 06:39:30.060261 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 12 06:39:30.060261 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 06:39:30.098160 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: Python main interpreter initialized at 0x564c33dd99c0 Aug 12 06:39:30.098160 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: python threads support enabled Aug 12 06:39:30.098160 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: your server socket listen backlog is limited to 100 connections Aug 12 06:39:30.098160 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: your mercy for graceful operations on workers is 90 seconds Aug 12 06:39:30.098511 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 06:39:30.098511 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: *** Operational MODE: preforking *** Aug 12 06:39:30.098808 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: *** uWSGI is running in multiple interpreter mode *** Aug 12 06:39:30.098808 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: spawned uWSGI master process (pid: 112010) Aug 12 06:39:30.099031 dv-cinder-844572-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 12 06:39:30.099583 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: spawned uWSGI worker 1 (pid: 112011, cores: 1) Aug 12 06:39:30.099874 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: spawned uWSGI worker 2 (pid: 112012, cores: 1) Aug 12 06:39:30.100081 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 06:39:30.744119 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 06:39:30.751311 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 06:39:31.808621 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 06:39:31.808621 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: from cryptography.utils import int_from_bytes Aug 12 06:39:31.809249 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 06:39:31.809249 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: from cryptography.utils import int_from_bytes Aug 12 06:39:31.852867 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 06:39:31.852867 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: from cryptography.utils import int_from_bytes Aug 12 06:39:31.853393 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 06:39:31.853393 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: from cryptography.utils import int_from_bytes Aug 12 06:39:34.275985 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 06:39:34.276572 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 06:39:34.276677 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 06:39:34.276677 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 06:39:34.277072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 06:39:34.277072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 06:39:34.277216 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 06:39:34.277299 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 06:39:34.277500 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 06:39:34.277716 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.277846 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 06:39:34.278003 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.278144 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.278355 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.278502 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.278601 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.278780 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.278908 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.279096 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.279306 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.279437 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.279570 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.279704 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.279886 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.280018 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.280208 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.280411 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.280547 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.280671 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.280776 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.280939 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.281033 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844572-2-iscsi {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.281258 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.281343 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.281584 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844572-2-iscsi {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.281670 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.281908 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.282000 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.282217 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.282310 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.282514 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.282597 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.282829 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.282939 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.283157 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.283245 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.283480 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.283676 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.283787 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285000 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285098 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285192 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285296 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285370 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285436 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285498 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285568 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285646 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285718 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285788 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285852 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.285920 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.286103 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.286184 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.286413 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.286521 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.286719 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.286824 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.287067 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.287174 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844572-2-iscsi {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.287382 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.287595 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.287766 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.287893 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844572-2-iscsi {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.288076 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.288208 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.288388 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.288512 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.288702 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.288840 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.289056 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.289176 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.289371 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.289494 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.289708 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.289825 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.290015 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.290138 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.290335 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.290475 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.290644 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.290778 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.290955 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.291109 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.291295 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.291418 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.291592 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.291727 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.291896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.292030 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.292200 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.292326 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.292508 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.292639 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.292803 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.292925 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.293099 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.293224 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.293343 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.293475 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.293628 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.293751 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.293938 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.294067 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.294248 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.294376 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.294561 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.294692 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.294823 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.294951 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.295107 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.295229 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.295357 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.295476 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.295658 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.295797 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.295961 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.296090 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.296264 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.296386 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.296596 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.296738 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.296861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.296981 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.297141 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.297280 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.297442 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.297539 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.297742 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.297832 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.298042 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.298129 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.298348 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.298434 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.298653 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.298739 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.298966 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.299097 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.299300 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.299399 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.299612 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.299697 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.299920 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.300005 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.300231 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.300317 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.300533 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.300627 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.300866 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.300964 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.301174 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.301261 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.301482 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.301568 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.301795 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.301895 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.302109 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.302195 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.302411 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.302497 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.302712 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.302811 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.303030 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.303137 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.303337 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.303424 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.303648 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.303743 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.303942 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.304027 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.304186 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.304272 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.304480 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.304581 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.304778 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.304863 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.305090 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.305203 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.305485 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.305622 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.305771 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.305857 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.306069 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.306154 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.306364 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.306450 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.306664 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.306750 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.306964 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.307121 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.307287 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.307373 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.307588 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.307675 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.307889 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.307973 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.308187 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.308273 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.308485 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.308571 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.308781 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.308918 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.309079 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.309165 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.309385 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.309530 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.309692 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.309829 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.309989 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.310111 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.310286 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.310409 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.310585 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.310724 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.310882 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.311067 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.311225 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.311347 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.311530 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.311727 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.311859 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.311977 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.312127 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.312252 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.312426 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.312566 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.312724 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.312854 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.313034 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.313154 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.313332 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.313463 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.313632 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.313760 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.313987 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.314133 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.314266 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.314408 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.314566 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.314793 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.314931 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.315078 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.315222 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.315356 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.315486 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.315629 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.315762 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.315890 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.316038 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.316169 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.316301 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.316445 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.316578 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.316710 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.316848 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.316991 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.317125 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.317256 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.317400 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.317536 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.317683 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.317815 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.317977 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.318110 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.318277 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.318420 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.318559 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.318695 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.318859 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.319015 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.319197 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.319297 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.319528 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.319625 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.319854 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.319944 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:39:34.320193 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.320386 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.320534 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.320669 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.320804 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.320952 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.321152 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.321306 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.321451 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.321584 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.321764 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.321912 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.322066 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.322208 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.322383 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.322523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.322690 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.322837 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.323003 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.323144 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.323310 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.323450 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.323621 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.323761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.323935 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.324102 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.324244 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.324406 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.324550 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.324690 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.324853 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.324993 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.325168 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.325307 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.325472 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.325612 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.325786 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.325922 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.326094 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.326236 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.326410 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.326558 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.326699 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.326912 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.327086 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.327222 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.327367 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.327591 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.327732 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.327864 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.328008 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.328141 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.328282 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.328428 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.328570 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.328704 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.328859 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.328999 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.329164 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.329316 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.329480 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.329621 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.329806 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.329955 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.330111 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.330260 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.330426 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.330566 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.330732 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.330872 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.331072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.331215 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.331385 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.331526 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.331692 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.331841 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.331999 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.332140 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.332298 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.332449 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.332596 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.332729 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.332905 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.333045 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.333211 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.333351 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.333522 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.333664 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.333879 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.334032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.334167 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.334299 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.334431 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.334563 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.334704 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.334848 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.335004 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.335143 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.335276 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.335420 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.335579 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.335725 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.335876 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.336022 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.336176 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.336324 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.336498 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.336778 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.337116 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.337355 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.337593 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.337867 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.338060 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.338242 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.338443 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.338626 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.338822 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.339059 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.339261 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.339406 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.339540 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.339672 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.339818 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.339951 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.340086 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.340218 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.340352 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.340496 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.340644 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.340784 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.340920 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.341053 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.341187 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.341327 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.341474 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.341608 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.341755 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.341890 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.342034 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.342168 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.342322 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.342473 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.342613 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.342757 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.342891 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.343089 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.343242 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.343376 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.343512 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.343645 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.343777 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.343918 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.344052 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.344197 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.344332 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.344464 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.344598 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.344738 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.344879 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.345011 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.345151 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.345285 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.345418 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.345563 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.345697 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.345840 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.345973 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.346105 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.346251 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.346386 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.346519 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.346651 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.346792 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.346932 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.347106 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.347106 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.347362 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.347496 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.347642 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.347775 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.348000 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.348140 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.348273 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.348414 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.348549 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.348682 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.348824 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.348958 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.349090 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.349223 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.349355 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.349507 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.349641 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.349774 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.349907 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.350051 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.350195 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.350338 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.350471 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.350605 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.350750 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.350885 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.351064 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.351220 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.351367 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.351501 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.351642 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.351777 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.351909 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.352059 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.352193 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.352326 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.352459 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.352598 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.352746 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.352880 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.353031 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.353165 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.353305 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.353447 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.353588 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.353723 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.353863 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.354004 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.354168 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.354311 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.354482 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.354623 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.354797 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.354947 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.355143 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.355284 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.355458 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.355599 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.355779 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.355920 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.356076 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.356223 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.356388 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.356528 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.356700 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.356839 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.357023 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.357176 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.357320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.357455 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.357631 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.357773 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.357932 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.358154 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.358294 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.358428 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.358561 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.358694 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.358834 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.359040 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.359183 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.359317 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.359451 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.359583 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.359728 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.359870 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.360005 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.360138 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.360279 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.360412 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.360585 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.360726 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.360900 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.361043 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.361209 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.361349 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.361555 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.361692 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.361825 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.361957 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.362091 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.362232 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.362410 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.362550 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.362740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.362896 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.363073 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.363219 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.363361 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.363498 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.363661 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.363808 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.363948 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.364090 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.364241 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.364375 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.364544 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.364693 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.364835 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.364978 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.365120 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.365256 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.365412 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.365565 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.365724 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.365876 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.366033 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.366180 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.366322 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.366456 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.366606 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.366747 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.366912 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.367110 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.367247 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.367381 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.367526 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.367670 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.367825 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.367998 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.368152 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.368353 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.368502 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.368646 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.368780 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.368912 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.369045 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.369177 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.369345 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.369489 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.369648 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.369787 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.369946 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.370086 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.370266 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.370413 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.370565 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.370698 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.370852 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.371018 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.371171 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.371306 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.371465 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.371605 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.371803 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.371952 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.372108 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.372247 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.372402 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.372536 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.372702 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.372848 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.373020 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.373166 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.373325 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.373472 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.373635 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.373785 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.373940 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.374080 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.374244 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.374406 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.374562 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.374710 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.374872 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.375045 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.375195 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.375329 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.375492 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.375645 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.375780 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.375913 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.376087 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.376234 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.376392 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.376527 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.376694 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.376844 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.376978 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.377113 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.377284 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.377424 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.377585 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.377737 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.377883 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.378017 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.378158 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.378310 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.378529 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.378668 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.378815 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.379042 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.379188 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.379372 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.379512 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.379682 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.379821 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.379995 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.380279 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.380430 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.380607 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.380754 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.380931 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.381085 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.381256 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.381395 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.381579 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.381719 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.381864 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.382005 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.382153 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.382286 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.382455 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.382603 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.382758 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.382897 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.383100 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.383252 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.383387 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.383549 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.383691 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.383825 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.383958 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.384099 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.384263 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.384412 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.384555 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.384699 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.384832 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.385043 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.385181 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.385314 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.385460 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.385594 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.385736 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.385870 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.386003 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.386180 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.386331 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.386489 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.386637 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.386798 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.386938 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.387144 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.387297 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.387454 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.387603 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.387737 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.387869 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.388038 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.388517 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.388721 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.388869 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.389011 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.389151 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.389292 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.389426 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.389577 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.389719 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.389859 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.389993 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.390191 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.390332 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.390484 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.390618 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.390793 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.390933 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.391129 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.391264 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.391409 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.391545 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.391679 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.391819 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.391980 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.392128 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.392284 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.392433 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.392576 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.392718 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.392877 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.393026 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.393182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.393322 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.393488 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.393630 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.393777 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.393928 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.394063 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.394213 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.394348 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.394480 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.394646 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.394794 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.394956 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.395121 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.395278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.395420 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.395565 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.395701 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.395859 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.395998 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.396164 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.396305 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.396455 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.396589 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.396745 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.396884 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.397047 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.397194 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.397337 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.397471 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.397641 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.397782 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.397940 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.398093 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.398246 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.398382 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.398515 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.398648 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.398863 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.399050 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.399248 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.399390 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.399524 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.399660 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.399801 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.399947 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.400092 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.400225 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.400357 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.400498 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.400656 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.400804 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.400966 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.401106 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.401273 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.401420 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.401575 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.401722 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.401882 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.402031 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.402187 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.402325 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.402498 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.402640 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.402780 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.402920 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.403110 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.403250 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.403397 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.403533 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.403695 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.403848 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.403982 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.404126 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.404272 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.404406 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.404566 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.404705 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.404864 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.405010 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.405158 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.405333 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.405472 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.405613 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.405763 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.405910 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.406050 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.406185 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.406326 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.406459 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.406592 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.406733 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.406867 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.407060 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.407202 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.407336 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.407513 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.407676 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.407813 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.407991 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.408129 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.408263 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.408404 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.408547 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.408687 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.408828 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.409075 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.409211 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.409354 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.409489 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.409632 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.409764 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.409905 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.410038 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.410205 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.410347 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.410519 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.410667 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.410826 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.410966 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.411166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.411308 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.411465 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.411615 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.411756 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.411896 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.412069 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.412209 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.412376 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.412515 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.412684 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.412824 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.413032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.413176 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.413310 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.413454 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.413587 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.413729 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.413862 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.414007 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.414188 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.414333 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.414466 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.414606 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.414766 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.414909 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.415114 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.415250 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.415403 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.415549 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.415691 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.415825 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.415957 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.416090 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.416257 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.416405 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.416547 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.416681 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.416856 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.416997 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.417138 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.417283 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.417448 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.417588 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.417752 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.417892 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.418033 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.418167 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.418353 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.418493 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.418658 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.418814 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.418993 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.419141 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.419291 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.419442 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.419590 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.419729 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.419879 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.420020 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.420178 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.420369 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.420516 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.420674 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.420825 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.420972 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.421125 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.421265 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.421406 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.421554 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.421694 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.421843 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.421990 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.422129 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.422269 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.422416 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.422564 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.422709 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.422858 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.423040 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.423275 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.423439 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.423582 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.423721 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.423869 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.424009 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.424161 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.424302 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.424458 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.424599 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.424738 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.424905 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.425072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.425221 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.425361 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.425509 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.425650 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.425814 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.425970 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.426112 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.426252 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.426391 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.426530 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.426705 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.426861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.427037 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.427185 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.427336 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.427476 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.427632 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.427782 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.427930 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.428079 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.428221 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.428438 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.428603 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.428745 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.428895 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.429036 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.429236 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.429383 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.429555 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.429702 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.429864 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.430020 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.430212 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.430400 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.430558 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.430700 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.430861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.431076 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.431224 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.431389 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.431539 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.431679 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.431828 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.431968 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.432116 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.432267 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.432415 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.432564 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.432715 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.432855 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.433008 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.433148 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.433295 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.433443 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.433585 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.433732 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.433954 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.434108 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.434271 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.434429 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.434572 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.434720 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.434872 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.435036 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.435200 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.435354 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.435507 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.435648 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.435790 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.435930 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.436080 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.436221 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.436362 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.436535 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.436683 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.436862 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.437018 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.437191 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.437338 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.437478 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.437618 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.437784 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.437939 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.438080 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.438227 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.438368 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.438515 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.438657 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.438816 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.438963 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.439180 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.439323 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.439463 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.439611 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.439753 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.439894 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.440033 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.440172 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.440320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.440468 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.440610 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.440769 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.440910 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.441049 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.441189 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.441337 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.441477 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.441617 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.441756 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.441897 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.442037 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.442193 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.442334 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.442491 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.442632 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.442773 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.442921 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.443104 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.443246 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.443386 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.443526 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.443708 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.443866 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.444017 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.444165 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.444326 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.444484 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.444632 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.444790 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.444934 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.445074 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.445243 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.445397 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.445545 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.445694 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.445837 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.445999 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.446144 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.446284 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.446442 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.446592 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.446733 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.446911 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.447102 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.447267 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.447453 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.447602 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.447703 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.447936 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.448067 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.448237 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.448400 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.448494 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.448575 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.448833 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.448966 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.449130 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.449278 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.449402 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.449512 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.449739 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.449871 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.450014 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.450112 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.450333 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.450477 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.450605 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.450700 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.450942 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.451133 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.451307 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.451408 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.451604 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.451752 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.451863 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.451946 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.452207 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.452352 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.452525 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.452673 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.452773 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.452858 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.453099 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.453189 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.453403 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.453506 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.453716 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.453806 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.454024 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.454114 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.454334 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.454438 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.454642 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.454732 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.454949 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.455061 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.455288 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.455393 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.455599 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.455689 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.455909 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.456107 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.456227 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.456429 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.456520 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.456739 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.456829 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.457047 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.457145 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.457348 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.457438 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.457658 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.457748 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.457961 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.458130 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.458268 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.458560 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.458651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.458848 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.459047 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.459209 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.459351 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.459493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.459659 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.459817 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.459973 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.460115 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.460265 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.460407 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.460553 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.460696 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.460849 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.460990 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.461130 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.461292 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.461446 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.461640 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.461801 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.461952 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.462099 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.462259 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.462411 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.462561 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.462701 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.462851 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.463035 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.463183 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.463323 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.463476 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.463618 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.463759 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.463910 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.464050 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.464198 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.464342 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.464489 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.464632 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.464772 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.464913 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.465135 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.465291 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.465433 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.465573 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.465731 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.465879 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.466033 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.466176 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.466317 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.466457 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.466597 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.466747 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.466887 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.467057 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.467203 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.467344 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.467509 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.467675 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.467824 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.468118 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.468266 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.468430 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.468583 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.468733 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.468874 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.469060 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.469214 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.469379 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.469533 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.469684 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.469822 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.469985 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.470132 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.470283 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.470436 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.470577 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.470816 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.470965 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.471144 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.471288 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.471481 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.471631 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.471781 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.471927 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.472077 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.472226 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.472381 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.472530 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.472680 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.472821 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.472961 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.473109 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.473252 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.473391 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.473617 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.473763 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.473927 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.474089 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.474231 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.474374 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.474520 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.474668 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.474837 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.475014 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.475165 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.475316 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.475465 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.475619 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.475760 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.475908 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.476049 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.476196 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.476464 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.476610 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.476763 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.476926 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.477084 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.477273 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.477427 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.477605 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.477770 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.477928 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.478077 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.478218 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.478364 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.478513 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.478662 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.478804 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.478944 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.479118 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.479260 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.479402 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.479565 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.479707 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.479856 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.479997 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.480138 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.480286 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.480434 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.480576 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.480716 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.480884 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.481039 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.481189 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.481329 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.481479 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.481628 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.481768 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.481916 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.482065 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.482205 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.482345 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.482485 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.482631 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.482773 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.482931 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.483131 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.483253 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.483340 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.483419 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.483635 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.483769 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.483941 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.484074 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.484261 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.484394 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.484540 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.484639 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.484863 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.484996 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.485185 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.485330 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.485456 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.485540 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.485795 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.485932 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.486101 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.486234 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.486413 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.486555 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.486721 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.486852 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.487005 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.487122 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.487351 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.487556 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.487653 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.487882 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.487974 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.488194 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.488286 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.488521 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.488612 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.488845 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.488936 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.489151 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.489247 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.489443 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.489533 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.489739 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.489829 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.490067 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.490176 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.490359 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.490449 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.490660 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.490941 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.491064 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.491281 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.491370 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.491582 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.491701 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.491872 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.492033 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.492179 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.492321 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.492462 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.492611 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.492767 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.492962 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.493105 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.493258 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.493399 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.493613 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.493765 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.493915 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.494057 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.494198 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.494338 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.494487 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.494628 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.494768 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.494914 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.495116 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.495276 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.495426 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.495591 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.495743 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.495893 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.496034 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.496186 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.496335 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.496484 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.496624 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.496764 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.496903 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.497063 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.497204 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.497345 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.497485 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.497626 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.497775 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.497925 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.498068 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.498209 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.498349 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.498510 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.499158 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.499391 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.499557 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.499700 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.499852 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.499994 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.500145 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.500287 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.500436 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.500580 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.500728 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.500871 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.501025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.501166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.501319 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.501460 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.501602 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.501761 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.501985 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.502140 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.502282 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.502423 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.502563 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.502719 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.502861 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.503055 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.503220 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.503362 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.503513 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.503665 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.503665 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.503948 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.504090 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.504230 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.504378 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.504532 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.504674 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.504821 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.504970 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.505121 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.505271 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.505447 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.505591 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.505733 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.505883 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.506024 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.506173 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.506314 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.506456 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.506602 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.506744 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.506894 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.507067 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.507219 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.507377 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.507519 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.507659 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.507812 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.508381 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.508566 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.508741 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.508741 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.509049 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.509203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.509373 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.509586 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.509731 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.509731 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.510011 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.510165 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.510307 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.510447 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.510588 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.510728 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.510869 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.511076 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.511224 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.511224 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.511510 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.511510 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.511785 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.511927 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.512161 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.512307 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.512449 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.512589 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.512739 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.513783 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.513938 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.514107 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.514307 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.514462 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.514604 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.514744 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.514893 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.515076 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.515235 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.515386 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.515527 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.515667 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.515807 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.515956 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.516117 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.516260 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.516402 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.516550 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.516691 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.516832 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.516980 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.517128 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.517271 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.517411 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.517554 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.517694 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.517854 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.517996 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.518136 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.518285 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.518427 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.518427 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.518711 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.518853 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.519030 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.519177 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.519319 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.519472 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.519638 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.519793 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.519934 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.520074 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.520269 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.520424 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.520573 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.520715 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.520856 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.520996 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.521135 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.521285 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.521426 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.521586 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.521727 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.521868 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.522021 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.522196 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.522351 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.522493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.522634 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.522774 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.523007 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.523169 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.523311 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.523470 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.523613 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.523755 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.523903 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.524046 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.524245 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.524388 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.524529 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.524680 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.524830 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.524971 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.525119 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.525268 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.525423 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.525577 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.525718 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.525859 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.526042 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.526191 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.526332 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.526481 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.526622 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.526764 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.526904 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.527092 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.527248 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.527398 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112012) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 06:39:34.527540 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.527540 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.527540 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.527540 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.527540 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.527540 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.527540 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.528447 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.528447 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.528723 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.528871 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.529102 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.529408 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:39:34.529652 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 06:39:34.678563 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO dbcounter [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Registered counter for database nova_api Aug 12 06:39:34.682239 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO dbcounter [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Registered counter for database nova_api Aug 12 06:39:34.701249 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_db.sqlalchemy.engines [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:39:34.703042 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG oslo_db.sqlalchemy.engines [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:39:34.708705 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writer thread running {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:39:34.709984 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG dbcounter [-] [112011] Writer thread running {{(pid=112011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:39:34.764203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.context [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ed89e9f-13dd-4dd0-a4be-01d22fad866b(cell1) {{(pid=112012) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 06:39:34.765370 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.context [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ed89e9f-13dd-4dd0-a4be-01d22fad866b(cell1) {{(pid=112011) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 06:39:34.768039 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:39:34.768514 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:39:34.769240 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG oslo_concurrency.lockutils [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:39:34.769715 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG oslo_concurrency.lockutils [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:39:34.770102 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:39:34.770838 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:39:34.771319 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG oslo_concurrency.lockutils [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:39:34.771452 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:39:34.772046 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG oslo_concurrency.lockutils [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:39:34.772495 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG oslo_concurrency.lockutils [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:39:34.773302 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:39:34.774489 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG oslo_concurrency.lockutils [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112011) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:39:34.775348 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO dbcounter [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Registered counter for database nova_cell0 Aug 12 06:39:34.776590 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO dbcounter [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Registered counter for database nova_cell0 Aug 12 06:39:34.780893 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO dbcounter [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Registered counter for database nova_cell1 Aug 12 06:39:34.781877 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO dbcounter [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Registered counter for database nova_cell1 Aug 12 06:39:34.789011 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_db.sqlalchemy.engines [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:39:34.790545 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG oslo_db.sqlalchemy.engines [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:39:34.794166 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG oslo_db.sqlalchemy.engines [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:39:34.794304 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writer thread running {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:39:34.796142 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG dbcounter [-] [112011] Writer thread running {{(pid=112011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:39:34.798540 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_db.sqlalchemy.engines [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:39:34.931668 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG dbcounter [-] [112011] Writer thread running {{(pid=112011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:39:34.934171 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writer thread running {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:39:34.940560 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO dbcounter [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Registered counter for database nova_cell0 Aug 12 06:39:34.943041 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO dbcounter [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Registered counter for database nova_cell0 Aug 12 06:39:34.952084 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG oslo_db.sqlalchemy.engines [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:39:34.957685 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_db.sqlalchemy.engines [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112012) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:39:34.960433 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG dbcounter [-] [112011] Writer thread running {{(pid=112011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:39:34.964011 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writer thread running {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:39:35.308958 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: WARNING keystonemiddleware.auth_token [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 06:39:35.309654 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: WARNING keystonemiddleware.auth_token [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 06:39:35.316283 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: WARNING keystonemiddleware.auth_token [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 06:39:35.316529 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: WARNING keystonemiddleware.auth_token [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 06:39:35.656317 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: WARNING keystonemiddleware.auth_token [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 06:39:35.660378 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: WARNING keystonemiddleware.auth_token [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 06:39:35.662257 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: WARNING keystonemiddleware.auth_token [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 06:39:35.666409 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: WARNING keystonemiddleware.auth_token [None req-5940b30d-acc8-47ea-bd20-f70ebfa828be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 06:39:35.667611 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c33dd99c0 pid: 112012 (default app) Aug 12 06:39:35.669703 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:39:35.670899 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 Aug 12 06:39:35.671340 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Fri Aug 12 06:39:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:39:35.671776 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c33dd99c0 pid: 112011 (default app) Aug 12 06:40:53.008106 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:40:53.009115 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 12 06:40:53.009473 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:40:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:40:53.022274 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG dbcounter [-] [112011] Writing DB stats nova_api:SELECT=3 {{(pid=112011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:40:53.023815 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG dbcounter [-] [112011] Writing DB stats nova_cell0:SELECT=3 {{(pid=112011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:40:53.024696 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG dbcounter [-] [112011] Writing DB stats nova_cell1:SELECT=3 {{(pid=112011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:40:53.025799 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG dbcounter [-] [112011] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:40:53.900495 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-d606d925-d454-4ea5-a64d-b6ba4444fd54 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:40:53.931806 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-d606d925-d454-4ea5-a64d-b6ba4444fd54 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.914811 Aug 12 06:40:53.932585 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Aug 12 06:40:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:40:56.207667 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:40:56.208785 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-aa3faa0b-9c59-40c0-9590-fcd98af65215 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 12 06:40:56.213883 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:40:56.652667 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-2eb37335-6eb4-441f-92a9-6dae5e594ea3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "ram": 256}} {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:40:56.672879 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 06:40:56.672879 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: warnings.warn(msg) Aug 12 06:40:56.702814 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-2eb37335-6eb4-441f-92a9-6dae5e594ea3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.487731 Aug 12 06:40:56.707016 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 06:40:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 06:40:56.920910 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-c01d8861-3f4f-4283-b885-d7c6263a6ce4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:40:56.925334 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 06:40:56.925334 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: warnings.warn(msg) Aug 12 06:40:56.940951 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writing DB stats nova_api:SELECT=3 {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:40:56.941072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writing DB stats nova_cell1:SELECT=3 {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:40:56.942009 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writing DB stats nova_cell0:SELECT=3 {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:40:56.942837 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:40:56.990708 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-c01d8861-3f4f-4283-b885-d7c6263a6ce4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277240 Aug 12 06:40:56.990708 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Aug 12 06:40:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:40:59.303317 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-2eb37335-6eb4-441f-92a9-6dae5e594ea3 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:40:59.304528 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-2eb37335-6eb4-441f-92a9-6dae5e594ea3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Aug 12 06:40:59.304966 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:40:59.954933 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b3f8bf71-02fb-4bd4-98e7-9348a073e49c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:40:59.974995 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 06:40:59.974995 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: warnings.warn(msg) Aug 12 06:40:59.998228 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-b3f8bf71-02fb-4bd4-98e7-9348a073e49c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.686528 Aug 12 06:40:59.999015 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 06:40:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:41:00.011361 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-4614fc96-2fca-430b-a8e6-9d8d14e29fe2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:00.014482 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 06:41:00.014482 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: warnings.warn(msg) Aug 12 06:41:00.048344 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-4614fc96-2fca-430b-a8e6-9d8d14e29fe2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041015 Aug 12 06:41:00.048932 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Aug 12 06:41:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:41:02.374572 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b3f8bf71-02fb-4bd4-98e7-9348a073e49c admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:02.375530 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-b3f8bf71-02fb-4bd4-98e7-9348a073e49c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 12 06:41:02.375937 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:02.778481 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-1b10a7dd-c7bb-40a7-bae2-05e6c1de8fc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "ram": 1024, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:02.798340 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-1b10a7dd-c7bb-40a7-bae2-05e6c1de8fc3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.416155 Aug 12 06:41:02.799003 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 06:41:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:41:02.811545 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-4a103726-8622-443c-9230-900f6fc00061 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:02.836615 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-4a103726-8622-443c-9230-900f6fc00061 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028940 Aug 12 06:41:02.837308 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Aug 12 06:41:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:41:05.162109 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-1b10a7dd-c7bb-40a7-bae2-05e6c1de8fc3 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:05.163797 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-1b10a7dd-c7bb-40a7-bae2-05e6c1de8fc3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Aug 12 06:41:05.164207 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:41:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:05.620762 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-3165f682-58e9-444a-950b-76985c6b2641 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:05.643026 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-3165f682-58e9-444a-950b-76985c6b2641 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472795 Aug 12 06:41:05.643857 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 06:41:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:41:05.656144 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-85a37f1c-c2fd-42d9-ad4e-25eb3b818a75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:05.683042 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-85a37f1c-c2fd-42d9-ad4e-25eb3b818a75 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030701 Aug 12 06:41:05.683729 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Aug 12 06:41:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:41:07.988918 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-3165f682-58e9-444a-950b-76985c6b2641 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:07.989816 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-3165f682-58e9-444a-950b-76985c6b2641 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 12 06:41:07.991292 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:41:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:08.417765 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-b8c3fbcc-6281-47e8-a0de-26813c628093 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4"}} {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:08.442895 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-b8c3fbcc-6281-47e8-a0de-26813c628093 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445934 Aug 12 06:41:08.445319 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 06:41:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:41:08.456690 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-4ce17c9d-fd1a-4c1e-a5cf-d631349f1d77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:08.482615 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-4ce17c9d-fd1a-4c1e-a5cf-d631349f1d77 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029789 Aug 12 06:41:08.487388 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Aug 12 06:41:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:41:11.300200 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-b8c3fbcc-6281-47e8-a0de-26813c628093 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:11.301692 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-b8c3fbcc-6281-47e8-a0de-26813c628093 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002191 Aug 12 06:41:11.302286 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:11.734328 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-e09ffd0c-dc00-4f8a-8bd2-699ddd21c682 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:11.761027 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-e09ffd0c-dc00-4f8a-8bd2-699ddd21c682 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.451953 Aug 12 06:41:11.761627 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Aug 12 06:41:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:41:14.148211 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-b8c3fbcc-6281-47e8-a0de-26813c628093 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:14.149505 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-b8c3fbcc-6281-47e8-a0de-26813c628093 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001919 Aug 12 06:41:14.149982 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:41:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:14.585299 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-206f6d24-da5b-4cf1-aa59-9a2f1b6ff4cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:14.611382 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-206f6d24-da5b-4cf1-aa59-9a2f1b6ff4cd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.453583 Aug 12 06:41:14.611934 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 06:41:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:41:14.625568 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-8c0cc823-1913-42c6-9e89-5c518e9b1a92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:14.654886 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-8c0cc823-1913-42c6-9e89-5c518e9b1a92 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034243 Aug 12 06:41:14.655500 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Aug 12 06:41:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:41:17.093152 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-206f6d24-da5b-4cf1-aa59-9a2f1b6ff4cd admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:17.094074 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-206f6d24-da5b-4cf1-aa59-9a2f1b6ff4cd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 12 06:41:17.094481 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:41:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:17.461531 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-f5ad74af-8f3b-4046-b6eb-45772480d01d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "vcpus": 1}} {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:17.480231 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-f5ad74af-8f3b-4046-b6eb-45772480d01d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.379454 Aug 12 06:41:17.480782 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 06:41:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 06:41:17.493054 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-39d5154a-89f3-44a5-afdd-c7044b0b275e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:17.518882 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-39d5154a-89f3-44a5-afdd-c7044b0b275e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029606 Aug 12 06:41:17.534488 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Aug 12 06:41:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:41:19.839308 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-f5ad74af-8f3b-4046-b6eb-45772480d01d admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:19.840328 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-f5ad74af-8f3b-4046-b6eb-45772480d01d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 12 06:41:19.840723 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:20.268882 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b8713c0c-89c0-42d1-b702-cdf8abd04712 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium"}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:20.292237 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-b8713c0c-89c0-42d1-b702-cdf8abd04712 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.445060 Aug 12 06:41:20.292787 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 06:41:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:41:20.307200 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-296d6931-e06f-4275-9760-47060f5afd73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:20.333063 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-296d6931-e06f-4275-9760-47060f5afd73 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031653 Aug 12 06:41:20.333759 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Aug 12 06:41:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:41:22.844238 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b8713c0c-89c0-42d1-b702-cdf8abd04712 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:22.845936 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-b8713c0c-89c0-42d1-b702-cdf8abd04712 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Aug 12 06:41:22.846349 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:41:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:23.276081 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-7c21cba8-3a58-4144-8746-d27334ba76f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "ram": 8192}} {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:23.281838 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG dbcounter [-] [112011] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:41:23.300602 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-7c21cba8-3a58-4144-8746-d27334ba76f0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.447542 Aug 12 06:41:23.301428 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 06:41:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 06:41:23.313315 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-906198b1-f7b0-4f85-bc81-74f68a4f8250 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:23.348664 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-906198b1-f7b0-4f85-bc81-74f68a4f8250 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038909 Aug 12 06:41:23.349473 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Aug 12 06:41:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:41:25.700173 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-7c21cba8-3a58-4144-8746-d27334ba76f0 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:25.701302 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-7c21cba8-3a58-4144-8746-d27334ba76f0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Aug 12 06:41:25.701762 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:41:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:26.220190 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b01db7ca-e4d6-4988-9320-f41348612bbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "vcpus": 8, "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:26.241969 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-b01db7ca-e4d6-4988-9320-f41348612bbd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.534021 Aug 12 06:41:26.242891 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 06:41:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 06:41:26.254918 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-db5a3578-58d6-44eb-b525-566567190c56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:26.284254 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-db5a3578-58d6-44eb-b525-566567190c56 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032900 Aug 12 06:41:26.284959 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Aug 12 06:41:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:41:44.284643 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b01db7ca-e4d6-4988-9320-f41348612bbd admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:44.286233 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-b01db7ca-e4d6-4988-9320-f41348612bbd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002247 Aug 12 06:41:44.286812 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:41:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:44.297409 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG dbcounter [-] [112011] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:41:44.704710 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-522ac42a-068c-4a54-ab04-50c1a2aa0870 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:44.723005 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-522ac42a-068c-4a54-ab04-50c1a2aa0870 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.430066 Aug 12 06:41:44.723536 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Aug 12 06:41:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:41:45.802169 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b01db7ca-e4d6-4988-9320-f41348612bbd admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:45.803201 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-b01db7ca-e4d6-4988-9320-f41348612bbd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 12 06:41:45.803585 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:41:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:46.375920 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-3c9d5d78-0ac6-4bd6-adc1-4cfab2993d05 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:46.381557 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.wsgi [None req-3c9d5d78-0ac6-4bd6-adc1-4cfab2993d05 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-3c9d5d78-0ac6-4bd6-adc1-4cfab2993d05 admin admin] Request method failure captured: Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Accept: application/json Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Accept-Encoding: gzip, deflate Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Connection: keep-alive Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Content-Length: 0 Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Host: 10.222.0.20 Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Openstack-Api-Version: compute 2.90 Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Openstack-System-Scope: None Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: User-Agent: python-novaclient Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Auth-Token: gAAAAABi9fYpo2A6NoNRDiRDMPVwPfJTgXFh95Y6SmpasW0kJ36YkuoGYxObbPciFqlplUebWqBKbqLtWXCZz37g3Br22D6izDmCRjAElMvbq3FO2akqUM76MWJCBnBT1jOkGl-DLXzwIqWWQIUsvvs_vr_5alAA2OEB7Mi7VauIJvfsJJGlgJU Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Domain-Id: None Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Domain-Name: None Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Identity-Status: Confirmed Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Is-Admin-Project: True Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Domain-Id: default Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Domain-Name: Default Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Name: admin Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Role: reader,member,admin Aug 12 06:41:46.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Roles: reader,member,admin Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7100960c9baa416badf1bb628ccee36d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Tenant: admin Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Tenant-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Tenant-Name: admin Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User: admin Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Domain-Id: default Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Domain-Name: Default Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Id: b50a510c1820446fa41980c74b2856f4 Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Name: admin Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: method: > Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: exception: Flavor 42 could not be found. Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: action_args: {'id': '42'} Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:41:46.386320 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:46.387523 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:46.388761 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-3c9d5d78-0ac6-4bd6-adc1-4cfab2993d05 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:41:46.390141 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-3c9d5d78-0ac6-4bd6-adc1-4cfab2993d05 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.443693 Aug 12 06:41:46.390141 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Aug 12 06:41:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 445 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 06:41:46.396573 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-87503678-ff71-4c16-a124-50fed1a42c6d admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:46.400721 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:41:46.419599 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-87503678-ff71-4c16-a124-50fed1a42c6d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026710 Aug 12 06:41:46.420129 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 06:41:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:41:46.430061 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-e25dffcd-d1d4-4e5b-8561-f106708e7f42 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:46.453743 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-e25dffcd-d1d4-4e5b-8561-f106708e7f42 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027294 Aug 12 06:41:46.454251 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 06:41:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:41:46.464325 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-a6eaa934-59fb-4818-84e8-2aeaea0cb06b admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:46.470529 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.wsgi [None req-a6eaa934-59fb-4818-84e8-2aeaea0cb06b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-a6eaa934-59fb-4818-84e8-2aeaea0cb06b admin admin] Request method failure captured: Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Accept: application/json Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Accept-Encoding: gzip, deflate Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Connection: keep-alive Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Content-Length: 0 Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Host: 10.222.0.20 Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Openstack-Api-Version: compute 2.90 Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Openstack-System-Scope: None Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: User-Agent: python-novaclient Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Auth-Token: gAAAAABi9fYpo2A6NoNRDiRDMPVwPfJTgXFh95Y6SmpasW0kJ36YkuoGYxObbPciFqlplUebWqBKbqLtWXCZz37g3Br22D6izDmCRjAElMvbq3FO2akqUM76MWJCBnBT1jOkGl-DLXzwIqWWQIUsvvs_vr_5alAA2OEB7Mi7VauIJvfsJJGlgJU Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Domain-Id: None Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Domain-Name: None Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Identity-Status: Confirmed Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Is-Admin-Project: True Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Domain-Id: default Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Domain-Name: Default Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Name: admin Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Role: reader,member,admin Aug 12 06:41:46.473896 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Roles: reader,member,admin Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7100960c9baa416badf1bb628ccee36d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Tenant: admin Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Tenant-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Tenant-Name: admin Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User: admin Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Domain-Id: default Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Domain-Name: Default Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Id: b50a510c1820446fa41980c74b2856f4 Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Name: admin Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: method: > Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: exception: Flavor 42 could not be found. Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: action_args: {'id': '42'} Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:41:46.475278 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:46.476166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:46.477203 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-a6eaa934-59fb-4818-84e8-2aeaea0cb06b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:41:46.478357 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-a6eaa934-59fb-4818-84e8-2aeaea0cb06b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015079 Aug 12 06:41:46.478357 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Aug 12 06:41:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 06:41:47.442737 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-e25dffcd-d1d4-4e5b-8561-f106708e7f42 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:47.443816 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-e25dffcd-d1d4-4e5b-8561-f106708e7f42 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001781 Aug 12 06:41:47.444179 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:41:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:48.001140 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-cc3608a4-8d48-41f6-97fd-31464289b6e1 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:48.006541 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.wsgi [None req-cc3608a4-8d48-41f6-97fd-31464289b6e1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-cc3608a4-8d48-41f6-97fd-31464289b6e1 admin admin] Request method failure captured: Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Accept: application/json Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Accept-Encoding: gzip, deflate Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Connection: keep-alive Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Content-Length: 0 Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Host: 10.222.0.20 Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Openstack-Api-Version: compute 2.90 Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Openstack-System-Scope: None Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: User-Agent: python-novaclient Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Auth-Token: gAAAAABi9fYrPU64JxB3IDgay_TrPG1vxw0kohRZHKJUqB8DUfngM950odZ2Ay-952zYWGpssMeReijml3hn7unBpttrXFfU71rZuRpGcnLs9Nb15MipsaXP0uNhIsMeO6-AxhvEfzkaMgdRdnhT-lTZWEER1dEFwIzus_cS3KCskWVq34YDKdM Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Domain-Id: None Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Domain-Name: None Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Identity-Status: Confirmed Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Is-Admin-Project: True Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Domain-Id: default Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Domain-Name: Default Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Name: admin Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Role: reader,member,admin Aug 12 06:41:48.008072 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Roles: reader,member,admin Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7100960c9baa416badf1bb628ccee36d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Tenant: admin Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Tenant-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Tenant-Name: admin Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User: admin Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Domain-Id: default Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Domain-Name: Default Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Id: b50a510c1820446fa41980c74b2856f4 Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Name: admin Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: method: > Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: exception: Flavor 84 could not be found. Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: action_args: {'id': '84'} Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:41:48.009651 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:48.010493 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:48.011620 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-cc3608a4-8d48-41f6-97fd-31464289b6e1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:41:48.012925 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-cc3608a4-8d48-41f6-97fd-31464289b6e1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.427829 Aug 12 06:41:48.012925 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Aug 12 06:41:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 06:41:48.019596 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-d60b057f-3e92-4081-aef9-2f24b95506c0 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:48.034318 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-d60b057f-3e92-4081-aef9-2f24b95506c0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018383 Aug 12 06:41:48.034819 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 06:41:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:41:48.044058 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-15f09ca2-3696-4db8-9dfe-660932761b28 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:48.060436 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-15f09ca2-3696-4db8-9dfe-660932761b28 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019883 Aug 12 06:41:48.060957 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 06:41:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:41:48.070238 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-7eaf415f-bcf8-4282-b49e-c23f01ebaa5c admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:48.077276 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.wsgi [None req-7eaf415f-bcf8-4282-b49e-c23f01ebaa5c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-7eaf415f-bcf8-4282-b49e-c23f01ebaa5c admin admin] Request method failure captured: Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Accept: application/json Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Accept-Encoding: gzip, deflate Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Connection: keep-alive Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Content-Length: 0 Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Host: 10.222.0.20 Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Openstack-Api-Version: compute 2.90 Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Openstack-System-Scope: None Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: User-Agent: python-novaclient Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Auth-Token: gAAAAABi9fYrPU64JxB3IDgay_TrPG1vxw0kohRZHKJUqB8DUfngM950odZ2Ay-952zYWGpssMeReijml3hn7unBpttrXFfU71rZuRpGcnLs9Nb15MipsaXP0uNhIsMeO6-AxhvEfzkaMgdRdnhT-lTZWEER1dEFwIzus_cS3KCskWVq34YDKdM Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Domain-Id: None Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Domain-Name: None Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Identity-Status: Confirmed Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Is-Admin-Project: True Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Domain-Id: default Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Domain-Name: Default Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Name: admin Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Role: reader,member,admin Aug 12 06:41:48.079766 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Roles: reader,member,admin Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7100960c9baa416badf1bb628ccee36d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Tenant: admin Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Tenant-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Tenant-Name: admin Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User: admin Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Domain-Id: default Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Domain-Name: Default Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Id: b50a510c1820446fa41980c74b2856f4 Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Name: admin Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: method: > Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: exception: Flavor 84 could not be found. Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: action_args: {'id': '84'} Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:41:48.081421 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:48.082427 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:48.084025 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-7eaf415f-bcf8-4282-b49e-c23f01ebaa5c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:41:48.085283 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-7eaf415f-bcf8-4282-b49e-c23f01ebaa5c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014591 Aug 12 06:41:48.085283 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Aug 12 06:41:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 06:41:49.073890 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-15f09ca2-3696-4db8-9dfe-660932761b28 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:49.074852 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-15f09ca2-3696-4db8-9dfe-660932761b28 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 12 06:41:49.075334 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:41:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:49.639183 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-93857c7e-be17-4f94-ab62-4e85b4c16a88 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:49.645072 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.wsgi [None req-93857c7e-be17-4f94-ab62-4e85b4c16a88 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-93857c7e-be17-4f94-ab62-4e85b4c16a88 admin admin] Request method failure captured: Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Accept: application/json Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Accept-Encoding: gzip, deflate Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Connection: keep-alive Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Content-Length: 0 Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Host: 10.222.0.20 Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Openstack-Api-Version: compute 2.90 Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Openstack-System-Scope: None Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: User-Agent: python-novaclient Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Auth-Token: gAAAAABi9fYsgE28F3LJpQlEBsqJEp6jMNoOiJna-h-My1OzE6pSVOPwoqgSb1Zhrttyy3R1SPUQ2sJzDTQWUUBpV-zP2bOQQshkpvEgt3A82i-_XDqMiojotvm1ySYZaePEGIsNWwP3jCFg1wO2Rw-geKyMhA1YgCnV2NWkP0MD8ZefOmWfeE0 Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Domain-Id: None Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Domain-Name: None Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Identity-Status: Confirmed Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Is-Admin-Project: True Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Domain-Id: default Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Domain-Name: Default Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Project-Name: admin Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Role: reader,member,admin Aug 12 06:41:49.646569 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Roles: reader,member,admin Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7100960c9baa416badf1bb628ccee36d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Tenant: admin Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Tenant-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-Tenant-Name: admin Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User: admin Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Domain-Id: default Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Domain-Name: Default Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Id: b50a510c1820446fa41980c74b2856f4 Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: X-User-Name: admin Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: method: > Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: exception: Flavor 451 could not be found. Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: action_args: {'id': '451'} Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:41:49.648150 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:49.648950 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: ERROR nova.api.openstack.wsgi Aug 12 06:41:49.650032 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-93857c7e-be17-4f94-ab62-4e85b4c16a88 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112011) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:41:49.651164 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-93857c7e-be17-4f94-ab62-4e85b4c16a88 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.435369 Aug 12 06:41:49.651164 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 06:41:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 06:41:49.658236 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-198ac272-b1d1-47f2-8b5e-bd1825e45822 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:49.673131 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-198ac272-b1d1-47f2-8b5e-bd1825e45822 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018689 Aug 12 06:41:49.673649 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 06:41:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:41:49.683034 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:49.698573 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018986 Aug 12 06:41:49.699115 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 06:41:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:41:49.710878 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b531a698-1607-4329-99ca-2fd314aff182 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:49.718943 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.wsgi [None req-b531a698-1607-4329-99ca-2fd314aff182 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b531a698-1607-4329-99ca-2fd314aff182 admin admin] Request method failure captured: Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Accept: application/json Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Accept-Encoding: gzip, deflate Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Connection: keep-alive Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Content-Length: 0 Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Host: 10.222.0.20 Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Openstack-Api-Version: compute 2.90 Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Openstack-System-Scope: None Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: User-Agent: python-novaclient Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Auth-Token: gAAAAABi9fYsgE28F3LJpQlEBsqJEp6jMNoOiJna-h-My1OzE6pSVOPwoqgSb1Zhrttyy3R1SPUQ2sJzDTQWUUBpV-zP2bOQQshkpvEgt3A82i-_XDqMiojotvm1ySYZaePEGIsNWwP3jCFg1wO2Rw-geKyMhA1YgCnV2NWkP0MD8ZefOmWfeE0 Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Domain-Id: None Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Domain-Name: None Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Identity-Status: Confirmed Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Is-Admin-Project: True Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Domain-Id: default Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Domain-Name: Default Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Project-Name: admin Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Role: reader,member,admin Aug 12 06:41:49.721182 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Roles: reader,member,admin Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7100960c9baa416badf1bb628ccee36d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7100960c9baa416badf1bb628ccee36d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Tenant: admin Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Tenant-Id: 7100960c9baa416badf1bb628ccee36d Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-Tenant-Name: admin Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User: admin Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Domain-Id: default Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Domain-Name: Default Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Id: b50a510c1820446fa41980c74b2856f4 Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: X-User-Name: admin Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: method: > Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: exception: Flavor 451 could not be found. Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: action_args: {'id': '451'} Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:41:49.722740 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:49.723717 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: ERROR nova.api.openstack.wsgi Aug 12 06:41:49.724861 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b531a698-1607-4329-99ca-2fd314aff182 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112012) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:41:49.726058 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-b531a698-1607-4329-99ca-2fd314aff182 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017498 Aug 12 06:41:49.726058 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 06:41:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 06:41:50.684788 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:50.686203 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001808 Aug 12 06:41:50.686801 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:41:51.231022 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-db7b7926-343c-43e6-97e2-c2cdd7447d28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:51.253169 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-db7b7926-343c-43e6-97e2-c2cdd7447d28 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.429802 Aug 12 06:41:51.253686 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Aug 12 06:41:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:41:52.240057 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:52.241076 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 12 06:41:52.241469 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:52.793765 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b4d01c0c-997f-400c-910e-f74526a6715a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:52.814667 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-b4d01c0c-997f-400c-910e-f74526a6715a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.436456 Aug 12 06:41:52.815268 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Aug 12 06:41:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:41:53.817506 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:53.818542 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 12 06:41:53.818931 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:54.370767 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-793c2031-16aa-42bb-93fd-5378741910fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:54.397166 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-793c2031-16aa-42bb-93fd-5378741910fa admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.439294 Aug 12 06:41:54.397870 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Aug 12 06:41:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:41:55.400229 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:55.401271 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 12 06:41:55.401640 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:41:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:55.952669 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b25ac315-4507-47d1-9fcb-b9abab47711d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:41:55.976615 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-b25ac315-4507-47d1-9fcb-b9abab47711d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.435717 Aug 12 06:41:55.977147 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Aug 12 06:41:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:41:56.947299 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:56.948311 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 12 06:41:56.948705 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:41:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:41:57.497365 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-74f57a75-933e-4369-9341-b04c3ca2e323 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:41:57.520264 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-74f57a75-933e-4369-9341-b04c3ca2e323 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.433281 Aug 12 06:41:57.520909 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Fri Aug 12 06:41:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:42:50.985263 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:42:50.986182 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-c64612ad-25fc-4bd6-b575-a29dbe1a2caa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 12 06:42:50.986594 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 06:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:42:50.997195 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:42:51.391105 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-ea0c715a-fd5b-41f2-be68-7bb99a965082 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:42:51.411874 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-ea0c715a-fd5b-41f2-be68-7bb99a965082 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.419147 Aug 12 06:42:51.412403 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Aug 12 06:42:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:42:51.433143 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG dbcounter [-] [112011] Writing DB stats nova_api:SELECT=14 {{(pid=112011) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:42:51.437064 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-8a7dd635-9894-497e-94fb-717236831fe1 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:42:51.445122 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-8a7dd635-9894-497e-94fb-717236831fe1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013384 Aug 12 06:42:51.445645 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Fri Aug 12 06:42:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:42:51.460107 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-74ef4484-f3d7-4b7d-8101-61fa92051e23 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:42:51.468080 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-74ef4484-f3d7-4b7d-8101-61fa92051e23 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013996 Aug 12 06:42:51.468601 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Fri Aug 12 06:42:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:42:51.479548 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-626859cc-b497-48ea-bd4a-d685204591b4 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:42:51.486992 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-626859cc-b497-48ea-bd4a-d685204591b4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010854 Aug 12 06:42:51.487510 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Fri Aug 12 06:42:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:42:51.498668 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-b3e49382-ba22-4a7e-9725-a2d36e180b5b admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:42:51.506675 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-b3e49382-ba22-4a7e-9725-a2d36e180b5b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011472 Aug 12 06:42:51.507241 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Fri Aug 12 06:42:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:45:49.382701 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-626859cc-b497-48ea-bd4a-d685204591b4 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:45:49.383817 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-626859cc-b497-48ea-bd4a-d685204591b4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 12 06:45:49.384188 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:45:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:45:49.521519 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writing DB stats nova_api:SELECT=6 {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:45:49.687874 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-04559e5c-94a6-4196-baa8-cedca1fb784e admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:45:49.690217 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 06:45:49.690217 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: warnings.warn(msg) Aug 12 06:45:49.691370 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-04559e5c-94a6-4196-baa8-cedca1fb784e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:45:49.691845 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-04559e5c-94a6-4196-baa8-cedca1fb784e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:45:49.692266 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-04559e5c-94a6-4196-baa8-cedca1fb784e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:45:49.692955 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-04559e5c-94a6-4196-baa8-cedca1fb784e admin admin] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:45:49.693387 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-04559e5c-94a6-4196-baa8-cedca1fb784e admin admin] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:45:49.693799 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-04559e5c-94a6-4196-baa8-cedca1fb784e admin admin] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:45:49.727009 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-04559e5c-94a6-4196-baa8-cedca1fb784e admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.207318 Aug 12 06:45:49.727586 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 06:45:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:45:50.549442 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-626859cc-b497-48ea-bd4a-d685204591b4 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:45:50.550473 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-626859cc-b497-48ea-bd4a-d685204591b4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 12 06:45:50.550879 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:45:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:45:50.739910 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-6eb233cf-f533-4c5a-9778-05102a1a3495 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:45:50.742431 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 06:45:50.742431 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: warnings.warn(msg) Aug 12 06:45:50.743589 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-6eb233cf-f533-4c5a-9778-05102a1a3495 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:45:50.744061 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-6eb233cf-f533-4c5a-9778-05102a1a3495 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:45:50.744515 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-6eb233cf-f533-4c5a-9778-05102a1a3495 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:45:50.745211 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-6eb233cf-f533-4c5a-9778-05102a1a3495 admin admin] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:45:50.745646 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-6eb233cf-f533-4c5a-9778-05102a1a3495 admin admin] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:45:50.746055 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-6eb233cf-f533-4c5a-9778-05102a1a3495 admin admin] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:45:50.766035 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-6eb233cf-f533-4c5a-9778-05102a1a3495 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080549 Aug 12 06:45:50.766517 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 06:45:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:46:02.012630 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-626859cc-b497-48ea-bd4a-d685204591b4 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:46:02.013630 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-626859cc-b497-48ea-bd4a-d685204591b4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 12 06:46:02.014026 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:46:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:46:02.155750 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writing DB stats nova_cell0:SELECT=4 {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:46:02.156474 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writing DB stats nova_cell1:SELECT=4 {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:46:02.157110 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG dbcounter [-] [112012] Writing DB stats nova_api:SELECT=8 {{(pid=112012) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:46:02.207454 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-7ba1be4a-4089-4ac3-abcb-b33671ac7479 admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:46:02.209879 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 06:46:02.209879 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: warnings.warn(msg) Aug 12 06:46:02.211003 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-7ba1be4a-4089-4ac3-abcb-b33671ac7479 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:46:02.211487 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-7ba1be4a-4089-4ac3-abcb-b33671ac7479 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:46:02.211912 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-7ba1be4a-4089-4ac3-abcb-b33671ac7479 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:46:02.212736 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-7ba1be4a-4089-4ac3-abcb-b33671ac7479 admin admin] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:46:02.213327 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-7ba1be4a-4089-4ac3-abcb-b33671ac7479 admin admin] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:46:02.213499 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-7ba1be4a-4089-4ac3-abcb-b33671ac7479 admin admin] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:46:02.238883 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-7ba1be4a-4089-4ac3-abcb-b33671ac7479 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087675 Aug 12 06:46:02.239467 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 06:46:02 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:46:03.072205 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: DEBUG nova.api.openstack.wsgi [None req-626859cc-b497-48ea-bd4a-d685204591b4 admin admin] Calling method '>' {{(pid=112011) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:46:03.073220 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: INFO nova.api.openstack.requestlog [None req-626859cc-b497-48ea-bd4a-d685204591b4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 12 06:46:03.073615 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: [pid: 112011|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 06:46:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:46:03.272381 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG nova.api.openstack.wsgi [None req-f6467ed7-c54d-4d40-8093-adaa3bed1e9e admin admin] Calling method '>' {{(pid=112012) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:46:03.275877 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 06:46:03.275877 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: warnings.warn(msg) Aug 12 06:46:03.277429 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-f6467ed7-c54d-4d40-8093-adaa3bed1e9e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:46:03.278032 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-f6467ed7-c54d-4d40-8093-adaa3bed1e9e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:46:03.278657 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-f6467ed7-c54d-4d40-8093-adaa3bed1e9e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:46:03.279688 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-f6467ed7-c54d-4d40-8093-adaa3bed1e9e admin admin] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:46:03.280302 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-f6467ed7-c54d-4d40-8093-adaa3bed1e9e admin admin] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:46:03.280852 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: DEBUG oslo_concurrency.lockutils [None req-f6467ed7-c54d-4d40-8093-adaa3bed1e9e admin admin] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112012) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:46:03.306458 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: INFO nova.api.openstack.requestlog [None req-f6467ed7-c54d-4d40-8093-adaa3bed1e9e admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.098541 Aug 12 06:46:03.306926 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: [pid: 112012|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 06:46:03 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:46:58.045750 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: Fri Aug 12 06:46:58 2022 - graceful shutdown triggered... Aug 12 06:46:58.046424 dv-cinder-844572-2-iscsi devstack@n-api.service[112012]: Gracefully killing worker 2 (pid: 112012)... Aug 12 06:46:58.045879 dv-cinder-844572-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 12 06:46:58.047356 dv-cinder-844572-2-iscsi devstack@n-api.service[112011]: Gracefully killing worker 1 (pid: 112011)... Aug 12 06:46:59.046919 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: worker 1 buried after 1 seconds Aug 12 06:46:59.047417 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: worker 2 buried after 1 seconds Aug 12 06:46:59.047417 dv-cinder-844572-2-iscsi devstack@n-api.service[112010]: goodbye to uWSGI. Aug 12 06:46:59.048681 dv-cinder-844572-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 12 06:46:59.049236 dv-cinder-844572-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 12 06:46:59.052132 dv-cinder-844572-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 12 06:46:59.065175 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 06:46:59 2022] *** Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: nodename: dv-cinder-844572-2-iscsi Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: machine: x86_64 Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: clock source: unix Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: pcre jit disabled Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: detected number of CPU cores: 4 Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: current working directory: / Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: detected binary path: /usr/bin/uwsgi-core Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: your processes number limit is 47680 Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: your memory page size is 4096 bytes Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: detected max file descriptor number: 2048 Aug 12 06:46:59.068249 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: lock engine: pthread robust mutexes Aug 12 06:46:59.069202 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: thunder lock: enabled Aug 12 06:46:59.069202 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 12 06:46:59.069202 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 06:46:59.112466 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: Python main interpreter initialized at 0x5609b32ae9c0 Aug 12 06:46:59.112466 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: python threads support enabled Aug 12 06:46:59.112466 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: your server socket listen backlog is limited to 100 connections Aug 12 06:46:59.112466 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: your mercy for graceful operations on workers is 90 seconds Aug 12 06:46:59.112952 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 06:46:59.112952 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: *** Operational MODE: preforking *** Aug 12 06:46:59.113204 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: *** uWSGI is running in multiple interpreter mode *** Aug 12 06:46:59.113204 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: spawned uWSGI master process (pid: 127069) Aug 12 06:46:59.113390 dv-cinder-844572-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 12 06:46:59.114769 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: spawned uWSGI worker 1 (pid: 127087, cores: 1) Aug 12 06:46:59.114769 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: spawned uWSGI worker 2 (pid: 127088, cores: 1) Aug 12 06:46:59.114769 dv-cinder-844572-2-iscsi devstack@n-api.service[127069]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 06:46:59.762894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 06:46:59.763571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 06:47:00.890120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 06:47:00.890120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: from cryptography.utils import int_from_bytes Aug 12 06:47:00.890876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 06:47:00.890876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: from cryptography.utils import int_from_bytes Aug 12 06:47:00.893317 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 06:47:00.893317 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: from cryptography.utils import int_from_bytes Aug 12 06:47:00.893804 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 06:47:00.893804 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: from cryptography.utils import int_from_bytes Aug 12 06:47:03.191763 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 06:47:03.192439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 06:47:03.192439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 06:47:03.192814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 06:47:03.193037 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 06:47:03.193456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.193778 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.194100 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.194402 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.194731 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.195039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.195358 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.195714 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.196036 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.196256 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.196603 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.196922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844572-2-iscsi {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.197240 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.197532 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.197830 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.198161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.198460 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.198776 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.199105 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.199615 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.200354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.200640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.201058 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.201433 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.201724 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.202040 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.202280 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 06:47:03.202970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.203220 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 06:47:03.203424 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.203424 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.203830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 06:47:03.204042 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.204275 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 06:47:03.204487 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844572-2-iscsi {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.204686 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 06:47:03.204898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.205110 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.205324 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.205533 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.205747 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.205957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.205957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.206371 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.206371 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.206809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.207025 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.207195 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.207380 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.207538 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.207685 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.207839 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.208006 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.208182 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.208330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.208481 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.208622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.208827 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.209001 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.209143 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844572-2-iscsi {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.209297 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.209472 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.209624 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.209763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.209901 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.210100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.210260 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.210401 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.210546 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.210695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.210853 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.211064 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.211227 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.211378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.211524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.211524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.211804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.211804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.213302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.213490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.213640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.215348 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.215508 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.215508 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.215811 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.215959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.216145 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.216305 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.216564 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.216713 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.217558 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.217724 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.217953 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.218101 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.218225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.218336 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.218444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.218551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.219000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844572-2-iscsi {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.219391 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.219571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.219754 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.219934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.220893 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.221056 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.221224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.221224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.221570 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.221711 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.221859 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.222025 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.222225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.222400 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.222668 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.222823 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.223152 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.223152 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.224134 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.224134 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.224472 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.224612 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.224749 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.224898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.225046 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.225186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.225332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.225470 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.225608 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.225759 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.225905 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.226053 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.226202 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.226349 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.226506 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.226646 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.226792 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.226939 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.227246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.227398 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.227553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.227701 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.227848 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.228013 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.228255 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.228418 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.228571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.228711 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.228850 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.229038 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.229192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.229346 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.229486 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.229757 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.229916 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.230066 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.230233 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.230390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.230529 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.230682 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.230934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.231112 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.231254 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.231402 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.231549 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.231696 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.231841 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.231980 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.232125 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.232296 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.232437 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.232583 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.232732 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.232882 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.233034 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.233174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.233320 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.233835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.234055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.234199 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.234354 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.234506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.234663 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.234810 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.234810 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.235117 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.235272 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.235412 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.235558 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.235715 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.235854 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.235999 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.236138 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.236276 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.236423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.236581 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.236728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.236867 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.237012 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.237172 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.237398 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.237548 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.237689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.240290 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.240486 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.240645 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.240800 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.240971 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.241218 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.241363 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.241501 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.241646 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.241803 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.241943 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.242097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.242253 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.242402 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.242548 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.242701 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.243157 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.243318 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.243459 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.244040 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.244269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.244431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.244579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.244726 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.244874 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.245022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.245206 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.245385 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.245526 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.245674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.245826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.245826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.246113 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.246260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.246400 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.246546 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.246685 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.246830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.246996 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.247143 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.247282 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.247525 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.247681 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.247833 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.247992 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.248144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.248283 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.248430 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.248578 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.248745 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.248999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.249166 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.249308 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.249459 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.249606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.249764 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.249904 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.250043 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.250240 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.250505 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.250651 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.250791 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.250936 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.251140 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.251475 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.251624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.251771 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.251910 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.252063 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.252221 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.252375 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.252523 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.252762 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.252921 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.253061 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.253209 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.253349 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.253537 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.253708 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.254222 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.254467 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.254622 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.254772 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.254920 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.254920 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.255225 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.255365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.255524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.255672 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.255820 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.255959 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.256105 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.256250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.256415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.256415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.256689 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.256835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.256975 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.257126 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.257266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.257403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.257565 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.257773 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.257917 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.258064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.258204 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.258362 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.258515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.258663 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.258803 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 06:47:03.258956 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.259176 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.259318 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.259457 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.259604 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.259750 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.259889 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.260036 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.260227 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.260387 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.260545 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.260780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.260931 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.261084 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.261231 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.261389 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.261618 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.261772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.261921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.262062 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.262217 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.262368 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.262515 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.262660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.262815 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.262961 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.263137 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.263285 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.263431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.263576 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.263730 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.263871 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.264335 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.264509 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.264725 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.264879 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.265032 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.265172 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.265318 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.265457 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.265596 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.265743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.265893 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.266033 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.266172 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.266310 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.266449 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.266615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.266763 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.266909 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.267191 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.267191 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.267472 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.267624 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.267781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.267994 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.268147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.268287 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.268425 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.268588 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.268728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.268866 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.269006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.269212 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.269367 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.269524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.269674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.269814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.269961 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.270101 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.270293 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.270439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.270589 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.270727 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.271027 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.271177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.271333 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.271866 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.272013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.272163 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.272312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.272451 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.272609 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.272755 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.272900 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.273049 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.273195 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.273345 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.273499 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.273654 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.273801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.273940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.274105 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.274579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.274745 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.274959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.275133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.275280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.275432 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.275591 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.275731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.275878 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.276017 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.276171 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.276319 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.276474 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.276614 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.276752 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.276899 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.277045 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.277197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.277349 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.277489 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.277635 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.277774 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.277920 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.278159 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.278304 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.278444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.278583 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.278722 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.278869 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.279148 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.279891 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.280050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.280191 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.280374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.280520 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.280675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.280815 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.280980 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.281206 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.281353 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.281492 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.281642 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.281782 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.281932 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.282077 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.282229 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.282380 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.282528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.282679 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.282943 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.283134 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.283278 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.283427 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.283575 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.283722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.283861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.284010 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.284149 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.284301 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.284808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.284988 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.285203 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.285348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.285502 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.285656 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.285797 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.285944 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.286090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.286240 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.286411 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.286675 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.286841 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.287006 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.287161 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.287302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.287449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.287629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.287629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.287912 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.288059 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.288279 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.288453 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.288595 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.288779 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.288927 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.289068 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.289207 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.289354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.289502 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.289641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.289789 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.289935 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.290084 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.290223 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.290420 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.290577 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.290727 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.290866 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.291035 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.291343 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.291493 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.291640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.291788 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.291936 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.292093 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.292237 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.292384 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.292548 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.292688 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.292826 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.293054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.293222 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.293370 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.293517 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.293670 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.293820 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.293962 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.294102 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.294244 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.294389 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.294557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.295090 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.295328 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.295484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.295624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.295763 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.295903 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.296091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.296237 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.296382 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.296520 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.296658 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.296819 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.296968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.297108 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.297246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.297388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.297542 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.297688 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.297835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.298005 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.298148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.298148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.298516 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.298672 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.298831 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.298970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.299180 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.299332 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.299473 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.299626 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.299766 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.299911 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.300049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.300187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.300358 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.300589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.300735 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.300895 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.301041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.301180 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.301318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.301602 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.301749 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.301889 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.302033 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.302183 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.302332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.302472 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.302612 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.302759 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.302918 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.303115 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.303282 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.303432 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.303578 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.303719 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.303857 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.303997 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.304150 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.304289 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.304428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.304567 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.304706 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.305191 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.305363 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.305578 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.305724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.305863 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.306002 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.306150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.306289 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.306434 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.306574 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.306720 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.306860 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.307043 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.307190 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.307330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.307477 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.307616 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.307762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.307910 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.308049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.308187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.308334 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.308501 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.308717 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.308871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.309024 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.309172 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.309312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.309451 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.309596 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.309816 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.309968 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.310108 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.310254 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.310394 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.310541 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.310725 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.310864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.311033 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.311177 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.311326 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.311475 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.311630 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.312001 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.312159 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.312308 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.312308 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.312586 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.312728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.312873 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.313019 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.313184 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.313337 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.313510 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.313771 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.313963 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.314114 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.314266 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.314426 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.314573 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.314726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.314890 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.315443 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.315691 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.315858 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.316043 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.316194 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.316350 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.316496 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.316649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.316796 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.316941 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.317094 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.317251 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.317405 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.317551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.317715 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.317861 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.318014 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.318169 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.318323 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.318485 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.318639 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.318875 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.319044 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.319209 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.319358 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.319511 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.319666 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.319821 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.319976 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.320149 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.320149 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.320575 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.320765 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.320915 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.321071 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.321217 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.321362 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.321509 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.321662 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.321815 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.322087 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.322253 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.322402 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.322550 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.322696 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.322842 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.323014 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.323169 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.323917 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.324073 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.324220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.324378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.324525 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.324672 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.324672 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.324971 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.324971 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.325626 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.325911 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.326115 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.326281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.326430 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.326584 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.326759 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.326909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.327115 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.327273 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.327426 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.327573 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.327573 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.327860 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.328019 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.328175 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.328330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.328485 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.328631 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.328800 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.329038 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.329455 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.329618 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.329802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.330053 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.330228 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.330387 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.330535 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.330690 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.330890 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.331069 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.331233 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.331392 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.331538 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.331758 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.331918 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.332754 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.332930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.333089 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.333246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.333400 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.333557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.333712 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.333867 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.334014 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.334180 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.334384 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.334534 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.334680 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.334836 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.335003 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.335157 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.335702 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.335860 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.336111 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.336506 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.336685 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.337070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.337268 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.337428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.337584 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.337750 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.337905 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.338052 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.338273 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.338438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.338587 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.338733 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.338889 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.339140 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.339311 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.339469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.339617 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.339770 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.339916 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.340075 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.340231 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.340386 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.340533 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.340680 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.340833 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.341039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.341198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.341365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.341512 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.341666 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.341820 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.341985 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.342133 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.342286 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.342434 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.342588 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.342839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.343116 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.343329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.343480 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.343645 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.343795 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.343950 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.344098 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.344245 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.344401 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.344547 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.344704 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.344859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.345013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.345329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.345824 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.345992 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.346221 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.346384 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.346540 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.346696 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.346851 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.347112 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.347315 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.347467 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.347613 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.347769 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.347926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.348079 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.348246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.348394 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.348541 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.348687 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.348843 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.348843 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.349222 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.349373 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.349527 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.349674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.349822 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.349977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.350137 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.350302 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.350488 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.350638 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.350785 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.351065 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.351222 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.351369 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.351523 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.351669 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.351815 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.351981 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.352129 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.352275 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.352441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.352604 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.352760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.352922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.353069 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.353317 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.353477 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.353625 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.353871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.354035 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.354190 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.354345 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.354504 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.354669 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.354835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.355000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.355161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.355308 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.355546 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.355961 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.356127 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.356355 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.356509 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.356655 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.356801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.356958 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.357120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.357268 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.357423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.357570 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.357723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.357878 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.358061 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.358226 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.358383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.358530 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.358677 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.358677 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.359022 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.359022 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.359322 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.359322 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.359600 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.359755 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.359902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.360047 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.360204 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.360351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.360505 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.360663 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.360663 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.360960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.361153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.361306 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.361459 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.361614 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.361760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.361912 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.362061 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.362215 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.362376 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.362523 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.362669 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.362843 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.363062 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.363223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.363482 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.363650 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.363800 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.363946 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.364093 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.364240 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.364401 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.364557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.364704 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.364858 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.365005 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.365165 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.365325 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.365481 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.365710 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.366139 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.366303 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.366531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.366695 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.366851 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.367025 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.367180 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.367344 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.367511 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.367659 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.367805 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.367960 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.368115 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.368269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.368429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.368577 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.368733 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.368887 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.369042 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.369193 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.369348 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.369504 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.369657 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.369657 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.369945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.370108 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.370255 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.370409 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.370562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.370718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.370874 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.371050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.371246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.371397 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.371553 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.371700 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.371847 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.372011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.372166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.372312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.372465 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.372620 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.372773 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.372930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.373075 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.373230 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.373393 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.373393 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.373786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.373944 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.374091 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.374091 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.374378 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.374536 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.374710 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.378484 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.378679 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.378854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.379090 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.379275 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.379440 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.379592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.379741 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.379896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.380052 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.380202 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.380362 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.380519 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.380666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.380823 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.380977 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.381143 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.381332 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.381483 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.381706 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.381811 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.381933 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.382050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.382186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.382285 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.382411 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.382507 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.382621 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.382719 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.382805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.382897 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.382997 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.383161 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.383280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.383372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.383452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.383636 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.383753 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.383753 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.383991 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.384077 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.384162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.384162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.384351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.384351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.384618 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.384717 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.384803 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.384912 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.385046 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.385165 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.385290 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.385415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.385539 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.385663 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.385801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.385925 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.386057 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.386184 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.386315 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.386439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.386569 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.386701 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.386834 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.386970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.387225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.387404 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.387531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.387663 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.387842 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.387976 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.388102 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.388670 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.388780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.388861 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.388978 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.389064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.389155 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.389275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.389371 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.389465 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.389465 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.389628 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.389712 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.389857 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.389991 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.390117 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.390250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.390376 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.390500 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.390635 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.390769 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.390866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.390950 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.391094 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.391196 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.391292 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.391385 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.391470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.391549 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.391684 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.391782 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.391878 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.391970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.392069 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.392161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.392254 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.392358 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.392452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.392537 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.392621 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.392711 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.392795 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.392887 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.392979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.393063 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.393204 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.393338 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.393427 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.393520 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.393606 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.393698 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.393835 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.393961 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.394059 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.394202 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.394291 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.394374 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.394465 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.394549 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.394642 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.394733 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.394825 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.394909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.395025 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.395126 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.395227 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.395319 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.395406 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.395497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.395588 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.395679 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.395773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.395864 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.395948 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.396038 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.396122 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.396217 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.396309 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.396309 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.396817 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.396907 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397000 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397093 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397178 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397261 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397527 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397620 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397706 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397789 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397873 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.397958 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.398051 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.398135 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.398224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.398333 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.398682 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.398774 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.398867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.398953 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.399113 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.399205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.399288 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.399379 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.399548 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.399637 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.399728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.399814 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.399896 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400034 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400034 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400200 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400292 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400376 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400459 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400555 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400647 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400647 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400647 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400647 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400942 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400942 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400942 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400942 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.400942 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.401329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.401427 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.401511 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.401593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.401593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.401734 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.401816 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.401915 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.402001 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.402001 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.402198 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.402289 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.402374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.402465 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.402465 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.402624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.402721 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.402813 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.402897 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403106 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403191 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403441 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403527 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403609 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403609 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403757 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403846 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.403944 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.404066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.404162 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.404162 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.404360 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.404450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.404547 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.404640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.404731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.404815 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.404904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405000 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405130 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405309 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405391 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405391 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405549 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405740 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405825 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.405997 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.406094 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.406185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.406268 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.406350 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.406441 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.406525 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.406525 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.406700 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.406700 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.406852 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.406944 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.407095 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.407190 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.407280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.407364 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.407453 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.407538 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.407634 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.407718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.407810 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.407810 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.407962 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.408056 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.408149 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.408232 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.408321 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.408405 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.408506 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.408789 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.408884 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.408969 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.409052 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.409134 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.409217 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.409309 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.409396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.409479 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.409570 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.409654 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.409780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.409876 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.409961 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.410046 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.410128 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.410200 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.410301 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.410387 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.410469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.410552 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.410630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.410712 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.410808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.410894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.411060 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.411161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.411254 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.411344 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.411437 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.411522 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.411617 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.411702 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.411702 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.411936 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.412031 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.412115 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.412197 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.412287 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.412410 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.412509 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.412594 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.412677 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.412767 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.412767 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.412930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413113 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413197 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413280 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413361 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413535 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413625 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413709 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413791 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413886 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.413982 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.414074 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.414196 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.414294 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.414380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.414506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.414609 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.414736 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.414830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.414924 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.415069 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.415157 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.415249 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.415337 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.415427 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.415511 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.415593 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.415674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.415765 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.415856 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.415947 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.416031 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.416121 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.416284 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.416369 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.416451 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.416533 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.416614 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.416705 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.416797 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.416889 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.416979 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.417063 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.417144 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.417233 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.417325 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.417465 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.417564 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.417656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.417748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.417832 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.417929 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.418024 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.418108 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.418193 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.418285 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.418383 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.418474 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.418474 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.418642 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.418914 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.419025 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.419132 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.419225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.419310 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.419401 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.419493 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.419576 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.419668 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.419759 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.419843 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.419932 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.420016 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.420127 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.420260 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.420351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.420444 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.420537 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.420627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.420723 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.420807 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.420807 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.420972 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.421063 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.421146 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.421247 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.421338 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.421421 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.421513 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.421603 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.421688 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.421783 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.421915 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422002 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422086 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422086 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422254 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422340 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422422 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422505 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422757 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422842 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.422931 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.423067 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.423166 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.423258 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.423352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.423443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.423528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.423617 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.423708 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.423802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.423894 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.423985 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424076 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424159 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424159 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424325 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424397 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424480 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424569 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424649 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424727 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424906 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.424990 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.425071 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.425071 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.425239 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.425356 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.425467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.425554 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.425640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.425729 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.425822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.425906 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.425995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.426079 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.426160 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.426243 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.426333 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.426425 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.426515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.426599 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.426683 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.426765 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.426856 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.426943 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.427044 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.427116 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.427116 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.427265 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.427371 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.427465 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.427548 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.427630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.427720 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.427826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.427910 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.428002 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.428093 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.428176 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.428265 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.428357 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.428448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.428538 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.428628 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.428711 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.428800 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.429028 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.429156 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.429257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.429352 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.429438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.429535 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.429620 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.429702 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.429792 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.429876 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.429966 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.430073 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.430159 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.430240 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.430322 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.430403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.430595 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.430754 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.430883 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.430995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.431188 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.431293 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.431515 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.431624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.431819 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.431999 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.432110 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.432314 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.432421 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.432637 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.432739 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.432960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.433068 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.433276 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.433405 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.433593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.433698 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.433915 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.434008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.434219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.434421 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.434533 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.434725 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.434839 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.435058 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.435243 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.435377 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.435519 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.435689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.435847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.435996 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.436172 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.436320 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.436479 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.436625 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.436786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.436930 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.437092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.437238 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.437402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.437550 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.437718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.437856 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.438028 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.438165 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.438332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.438489 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.438618 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.438775 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.439162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.439374 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.439468 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.439541 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.439641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.439794 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.439892 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.440043 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.440219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.440339 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.440552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.440653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.440858 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.440980 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.441162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.441277 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.441465 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.441587 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.441817 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.441919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.442059 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.442239 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.442350 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.442547 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.442646 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.442854 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.442948 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.443178 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.443276 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.443410 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 06:47:03.443553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.443862 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.444165 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.444496 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.444830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.445149 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.445470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.445782 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.446102 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.446414 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.446738 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.447088 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.447408 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.447721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.448055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.448377 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.448676 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.448988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.449444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.449592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.449894 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.450226 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.450552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.450858 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.451212 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.451531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.451855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.452176 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.452489 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.452818 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.453131 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.453442 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.453754 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.454063 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.454376 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.454755 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.455042 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.455332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.455653 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.455970 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.456300 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.456628 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.457055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.457381 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.457709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.458066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.458379 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.458732 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.459087 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.459483 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.459716 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.460029 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 06:47:03.460274 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 06:47:03.602414 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO dbcounter [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Registered counter for database nova_api Aug 12 06:47:03.620417 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Registered counter for database nova_api Aug 12 06:47:03.623209 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_db.sqlalchemy.engines [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:47:03.630274 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writer thread running {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:47:03.640686 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:47:03.647864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:47:03.687407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.context [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ed89e9f-13dd-4dd0-a4be-01d22fad866b(cell1) {{(pid=127087) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 06:47:03.691477 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:47:03.692011 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:47:03.693582 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:47:03.694340 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:47:03.694785 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:47:03.696812 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:47:03.698804 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO dbcounter [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Registered counter for database nova_cell0 Aug 12 06:47:03.702996 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO dbcounter [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Registered counter for database nova_cell1 Aug 12 06:47:03.704349 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.context [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ed89e9f-13dd-4dd0-a4be-01d22fad866b(cell1) {{(pid=127088) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 06:47:03.708417 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:47:03.708885 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:47:03.710475 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:47:03.711269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:47:03.711780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:47:03.716246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:47:03.716246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Registered counter for database nova_cell0 Aug 12 06:47:03.717230 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_db.sqlalchemy.engines [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:47:03.719158 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_db.sqlalchemy.engines [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:47:03.720361 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Registered counter for database nova_cell1 Aug 12 06:47:03.724836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writer thread running {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:47:03.728088 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:47:03.729463 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writer thread running {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:47:03.732015 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:47:03.739839 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:47:03.740178 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:47:03.878171 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO dbcounter [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Registered counter for database nova_cell0 Aug 12 06:47:03.885047 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_db.sqlalchemy.engines [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:47:03.889496 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Registered counter for database nova_cell0 Aug 12 06:47:03.890145 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writer thread running {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:47:03.896362 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 06:47:03.901561 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 06:47:04.206244 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: WARNING keystonemiddleware.auth_token [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 06:47:04.213841 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: WARNING keystonemiddleware.auth_token [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 06:47:04.218656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 06:47:04.226123 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 06:47:04.561039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: WARNING keystonemiddleware.auth_token [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 06:47:04.567317 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: WARNING keystonemiddleware.auth_token [None req-f353b4f9-182b-4c88-ad34-216c4ad17555 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 06:47:04.570578 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 06:47:04.573656 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5609b32ae9c0 pid: 127087 (default app) Aug 12 06:47:04.576734 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-39ae8181-dab3-4917-a07b-242c5482f56b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 06:47:04.583120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5609b32ae9c0 pid: 127088 (default app) Aug 12 06:47:43.013124 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-53233af0-a1dd-4c7b-b078-c636c9ba06a2 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] Calling method '.version_select at 0x7fc706ec18b0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:43.102674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:47:43.112586 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:47:43.113636 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:47:43.119003 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:47:44.127531 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-53233af0-a1dd-4c7b-b078-c636c9ba06a2 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/1416697c-dc7d-4b47-86cf-7a8e3628eae7" status: 200 len: 351 microversion: 2.1 time: 1.533334 Aug 12 06:47:44.129171 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 1/1] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:47:42 2022] GET /compute/v2.1/os-volumes/1416697c-dc7d-4b47-86cf-7a8e3628eae7 => generated 351 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:47:45.920817 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:47:45.922743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:47:45.923636 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:47:45.924392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:47:46.320428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-25b34649-4360-40fa-9add-52d82f915adf tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] Calling method '.version_select at 0x7fc706e5b820>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:47.120909 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-25b34649-4360-40fa-9add-52d82f915adf tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b603da3f-908f-4911-a974-b92c3fe70b5d" status: 200 len: 351 microversion: 2.1 time: 1.221325 Aug 12 06:47:47.130586 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:47:45 2022] GET /compute/v2.1/os-volumes/b603da3f-908f-4911-a974-b92c3fe70b5d => generated 351 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:47:48.799457 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f90ddc6b-65e4-416e-a6ef-077fd39cde41 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] Calling method '.version_select at 0x7fc706d15c10>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:48.913209 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f90ddc6b-65e4-416e-a6ef-077fd39cde41 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a3dc1d16-b1a6-429e-863a-fd01b5330818" status: 200 len: 351 microversion: 2.1 time: 0.117827 Aug 12 06:47:48.914049 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:47:48 2022] GET /compute/v2.1/os-volumes/a3dc1d16-b1a6-429e-863a-fd01b5330818 => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:47:48.927234 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-33c050ed-83e8-4f92-906a-d810c57050ba tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] Calling method '.version_select at 0x7fc706c9eaf0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:49.359838 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-33c050ed-83e8-4f92-906a-d810c57050ba tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.436578 Aug 12 06:47:49.365002 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1134 bytes} [Fri Aug 12 06:47:48 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:47:49.375689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-62ae2d71-e827-42a0-9e53-c7a514ebdb36 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] Calling method '.version_select at 0x7fc706d15ca0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:49.556114 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-62ae2d71-e827-42a0-9e53-c7a514ebdb36 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.184095 Aug 12 06:47:49.557145 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1149 bytes} [Fri Aug 12 06:47:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:47:49.582001 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f8115b93-7d98-43b2-b2c5-038865723701 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] Calling method '.version_select at 0x7fc706c9ee50>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:49.805006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f8115b93-7d98-43b2-b2c5-038865723701 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.238218 Aug 12 06:47:49.805743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1134 bytes} [Fri Aug 12 06:47:49 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:47:49.818444 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d611533a-956e-482a-b398-ae8312356a17 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] Calling method '.version_select at 0x7fc706d15af0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:50.367227 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d611533a-956e-482a-b398-ae8312356a17 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.552449 Aug 12 06:47:50.368990 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1167 bytes} [Fri Aug 12 06:47:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:47:50.383850 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b2453c49-c8fc-492c-8165-b71b85b0dd6a tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] Calling method '.version_select at 0x7fc706c5dd30>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:50.571641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b2453c49-c8fc-492c-8165-b71b85b0dd6a tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.193035 Aug 12 06:47:50.580701 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1170 bytes} [Fri Aug 12 06:47:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:47:50.587135 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-10679d72-b276-4d5c-83f1-0978e0c2f231 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] Calling method '.version_select at 0x7fc706cd7e50>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:50.754729 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-10679d72-b276-4d5c-83f1-0978e0c2f231 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.172366 Aug 12 06:47:50.755879 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1155 bytes} [Fri Aug 12 06:47:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:47:50.772130 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-82acc013-03c8-480f-83ce-b9940550bb96 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] Calling method '.version_select at 0x7fc706c5db80>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:50.920517 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-82acc013-03c8-480f-83ce-b9940550bb96 tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.155728 Aug 12 06:47:50.923401 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1188 bytes} [Fri Aug 12 06:47:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:47:50.936152 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1180e50c-9590-428c-b3d9-ab2bd355027d tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] Calling method '.version_select at 0x7fc706c700d0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:51.121369 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1180e50c-9590-428c-b3d9-ab2bd355027d tempest-VolumesTestJSON-1911580596 tempest-VolumesTestJSON-1911580596-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.191072 Aug 12 06:47:51.122793 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1155 bytes} [Fri Aug 12 06:47:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:47:53.349442 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1079603785", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:47:53.548234 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] validate_networks() for [('85d9adca-c1e4-4674-a4ec-42c68e097d7e', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:47:55.863734 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2b1eca0f-22ed-4f21-93da-2c2c87825b36 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: .version_select at 0x7fc706c740d0>, body: {"keypair": {"name": "tempest-keypair-433145148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqnKJcVfqwUrvkZvAYuXsIvV+DlVFpIbKt8BKIp3LcyfHJGneO1lhlxNL8FMc95ZmFzsN2Z3M19R9rdv6GeGr0UogfK09t2aH+sGGRsbeuwYM/783dSWfgFGh74+QWn6g=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:47:55.965096 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-2b1eca0f-22ed-4f21-93da-2c2c87825b36 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for project b89f418ef5fd41b39c0a0a36968da428. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:47:55.972264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-2b1eca0f-22ed-4f21-93da-2c2c87825b36 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for user 342ef719c63d4fbfa5a2a3943bd3b24b and project b89f418ef5fd41b39c0a0a36968da428. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:47:56.091346 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2b1eca0f-22ed-4f21-93da-2c2c87825b36 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.597379 Aug 12 06:47:56.092875 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 7/12] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 06:47:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:47:56.662203 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:47:56.663273 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:47:56.664095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:47:56.664654 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:47:56.665554 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:47:56.702808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:47:56.703914 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:47:56.704509 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:47:56.705473 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:47:56.706164 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:47:56.706877 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:47:56.788201 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Getting quotas for project 9871a1ac34bd4164bd662499cf299cbe. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:47:56.808103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Getting quotas for user cf53f022a26d48b3aa70cea4f5fbc1c3 and project 9871a1ac34bd4164bd662499cf299cbe. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:47:56.836125 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:47:56.841412 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:47:57.086006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9305405d-bee9-46ab-a27f-66c8f3cc0473 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.919864 Aug 12 06:47:57.099564 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 6/13] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:47:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 3934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 06:47:57.100955 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-46552dc2-2043-4707-9609-192d240a7252 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:57.102186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-46552dc2-2043-4707-9609-192d240a7252 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:47:57.316246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-46552dc2-2043-4707-9609-192d240a7252 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:47:57.341899 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-46552dc2-2043-4707-9609-192d240a7252 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1222 microversion: 2.1 time: 0.246305 Aug 12 06:47:57.375748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:47:57 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1222 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:47:57.549356 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1653729344", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:47:57.723635 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] validate_networks() for [('85d9adca-c1e4-4674-a4ec-42c68e097d7e', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:47:59.551458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:47:59.552268 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:47:59.552361 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:47:59.552709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:47:59.553524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:47:59.582390 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:47:59.582881 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:47:59.583335 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:47:59.589407 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:47:59.589946 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:47:59.595356 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:47:59.682213 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Getting quotas for project 9871a1ac34bd4164bd662499cf299cbe. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:47:59.693657 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Getting quotas for user cf53f022a26d48b3aa70cea4f5fbc1c3 and project 9871a1ac34bd4164bd662499cf299cbe. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:47:59.726613 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:47:59.728782 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:47:59.898446 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6b897773-189f-42f0-a9b3-0e5e187cdfb6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.353943 Aug 12 06:47:59.901639 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 7/15] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:47:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:47:59.912130 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e492475b-fad4-4375-be72-f9fd114accfa tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:47:59.912739 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e492475b-fad4-4375-be72-f9fd114accfa tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:00.174961 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e492475b-fad4-4375-be72-f9fd114accfa tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:00.185483 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e492475b-fad4-4375-be72-f9fd114accfa tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1222 microversion: 2.1 time: 0.277289 Aug 12 06:48:00.220219 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:47:59 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1222 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:01.233510 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-241547e0-5c66-4274-ac35-d3788185891c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:01.234159 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-241547e0-5c66-4274-ac35-d3788185891c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:01.332523 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-241547e0-5c66-4274-ac35-d3788185891c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:01.334024 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-241547e0-5c66-4274-ac35-d3788185891c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:01.346424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-241547e0-5c66-4274-ac35-d3788185891c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:01.349565 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-241547e0-5c66-4274-ac35-d3788185891c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:01.351198 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-241547e0-5c66-4274-ac35-d3788185891c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:01.351860 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-241547e0-5c66-4274-ac35-d3788185891c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:01.871242 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-241547e0-5c66-4274-ac35-d3788185891c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:01.908908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-241547e0-5c66-4274-ac35-d3788185891c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1226 microversion: 2.1 time: 0.675902 Aug 12 06:48:01.920975 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 8/17] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:01 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1226 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:02.385902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bb025dd4-97b4-438c-9e75-57487a970a1a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Action: 'create', calling method: .version_select at 0x7fc7063c5ee0>, body: {"keypair": {"name": "tempest-keypair-1768940355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC8ryoutlqh7h0952YbBWa191kj0E0Brm2CvavwxEn4nWPqGnGDau1HcP26cRR+FrBpnwLTScqeuk0syQrVVUgiu2GcE3WjSmMS1Z8sZBeKvgRBQBy8iu55ftbbQYtfWw=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:02.423432 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-bb025dd4-97b4-438c-9e75-57487a970a1a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Getting quotas for project 9f03ba37e3ca430d8f7777a28b2819d3. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:48:02.457638 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-bb025dd4-97b4-438c-9e75-57487a970a1a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Getting quotas for user 4f4a5b4ebab2440faab418f58b87942f and project 9f03ba37e3ca430d8f7777a28b2819d3. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:48:02.525863 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bb025dd4-97b4-438c-9e75-57487a970a1a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.041494 Aug 12 06:48:02.526642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 10/18] 10.222.0.20 () {62 vars in 1200 bytes} [Fri Aug 12 06:48:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1043 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 12 06:48:02.941521 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5beac72c-f6d3-4336-88d3-cb04b5e4e709 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:02.942130 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5beac72c-f6d3-4336-88d3-cb04b5e4e709 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:02.966484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5beac72c-f6d3-4336-88d3-cb04b5e4e709 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:02.967014 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5beac72c-f6d3-4336-88d3-cb04b5e4e709 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:02.967464 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5beac72c-f6d3-4336-88d3-cb04b5e4e709 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:02.968506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5beac72c-f6d3-4336-88d3-cb04b5e4e709 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:02.968966 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5beac72c-f6d3-4336-88d3-cb04b5e4e709 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:02.969387 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5beac72c-f6d3-4336-88d3-cb04b5e4e709 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:03.322748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5beac72c-f6d3-4336-88d3-cb04b5e4e709 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:03.345920 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-68ba49d5-81c4-42bf-9ecd-51445f2770c1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Action: 'create', calling method: .version_select at 0x7fc70638a1f0>, body: {"keypair": {"name": "tempest-keypair-1691547418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe07YMKTqRztGXeuxEfKDjnxscRYE2F19hpTCaPs7J9yAud3lh7oNWivDp9ioLbDKHG0myJdfd8OKQhdi/Gua2NYo6UUV1QEl5fG/YkD68gkDpyB5dXRTPl9xS7O8DqMw=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:03.350897 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5beac72c-f6d3-4336-88d3-cb04b5e4e709 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1280 microversion: 2.1 time: 0.413588 Aug 12 06:48:03.353832 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 11/19] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:02 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1280 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:03.399138 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-68ba49d5-81c4-42bf-9ecd-51445f2770c1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Getting quotas for project 953a18a150ee420b908ea4c3665811b6. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:48:03.404337 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-68ba49d5-81c4-42bf-9ecd-51445f2770c1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Getting quotas for user 498c574c32a341a59287de043fa0fe3f and project 953a18a150ee420b908ea4c3665811b6. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:48:03.472639 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-68ba49d5-81c4-42bf-9ecd-51445f2770c1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.741170 Aug 12 06:48:03.473420 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 9/20] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 06:48:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:04.392728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b559cbc1-2a68-4003-bc56-605632da7010 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:04.396335 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b559cbc1-2a68-4003-bc56-605632da7010 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:04.416753 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559cbc1-2a68-4003-bc56-605632da7010 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:04.420882 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559cbc1-2a68-4003-bc56-605632da7010 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:04.425579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559cbc1-2a68-4003-bc56-605632da7010 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:04.429170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559cbc1-2a68-4003-bc56-605632da7010 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:04.431722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559cbc1-2a68-4003-bc56-605632da7010 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:04.433408 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559cbc1-2a68-4003-bc56-605632da7010 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:05.014277 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b559cbc1-2a68-4003-bc56-605632da7010 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:05.029579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b559cbc1-2a68-4003-bc56-605632da7010 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1280 microversion: 2.1 time: 0.655386 Aug 12 06:48:05.032603 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 12/21] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:04 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1280 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:06.056548 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8aa27068-1758-4db8-9b1d-416c4161b00a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:06.057470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8aa27068-1758-4db8-9b1d-416c4161b00a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:06.071210 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa27068-1758-4db8-9b1d-416c4161b00a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:06.076204 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa27068-1758-4db8-9b1d-416c4161b00a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:06.079248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa27068-1758-4db8-9b1d-416c4161b00a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:06.080898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa27068-1758-4db8-9b1d-416c4161b00a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:06.086267 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa27068-1758-4db8-9b1d-416c4161b00a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:06.090593 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa27068-1758-4db8-9b1d-416c4161b00a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:06.412772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8aa27068-1758-4db8-9b1d-416c4161b00a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:06.420918 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8aa27068-1758-4db8-9b1d-416c4161b00a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1280 microversion: 2.1 time: 0.370449 Aug 12 06:48:06.421512 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 10/22] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:06 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1280 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:07.442568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b2551817-10fc-49b1-8481-38bdf858cb6a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:07.443402 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b2551817-10fc-49b1-8481-38bdf858cb6a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:07.461858 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b2551817-10fc-49b1-8481-38bdf858cb6a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:07.465882 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b2551817-10fc-49b1-8481-38bdf858cb6a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:07.468981 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b2551817-10fc-49b1-8481-38bdf858cb6a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:07.472387 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b2551817-10fc-49b1-8481-38bdf858cb6a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:07.476239 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b2551817-10fc-49b1-8481-38bdf858cb6a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:07.478314 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b2551817-10fc-49b1-8481-38bdf858cb6a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:07.838998 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b2551817-10fc-49b1-8481-38bdf858cb6a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:07.854109 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b2551817-10fc-49b1-8481-38bdf858cb6a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1280 microversion: 2.1 time: 0.413031 Aug 12 06:48:07.857337 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 13/23] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:07 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1280 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:08.878611 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6ad75d18-e26c-4d0a-a61a-da5fe32b2211 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:08.880257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6ad75d18-e26c-4d0a-a61a-da5fe32b2211 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:08.891234 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ad75d18-e26c-4d0a-a61a-da5fe32b2211 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:08.900481 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ad75d18-e26c-4d0a-a61a-da5fe32b2211 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:08.902103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ad75d18-e26c-4d0a-a61a-da5fe32b2211 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:08.903970 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ad75d18-e26c-4d0a-a61a-da5fe32b2211 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:08.906528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ad75d18-e26c-4d0a-a61a-da5fe32b2211 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:08.909217 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ad75d18-e26c-4d0a-a61a-da5fe32b2211 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:09.512384 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ad75d18-e26c-4d0a-a61a-da5fe32b2211 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:09.526297 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6ad75d18-e26c-4d0a-a61a-da5fe32b2211 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1280 microversion: 2.1 time: 0.652602 Aug 12 06:48:09.526951 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:08 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1280 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:10.550888 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-22816659-61cd-48b9-82e9-5e03a641d3cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:10.552012 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-22816659-61cd-48b9-82e9-5e03a641d3cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:10.584821 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22816659-61cd-48b9-82e9-5e03a641d3cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:10.586844 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22816659-61cd-48b9-82e9-5e03a641d3cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:10.587976 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22816659-61cd-48b9-82e9-5e03a641d3cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:10.592444 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22816659-61cd-48b9-82e9-5e03a641d3cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:10.593404 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22816659-61cd-48b9-82e9-5e03a641d3cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:10.595274 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22816659-61cd-48b9-82e9-5e03a641d3cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:11.580016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-496343371", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f384a833-4d30-4845-aa83-a1cad46c6a6b"}], "security_groups": [{"name": "tempest-securitygroup--1428065883"}], "key_name": "tempest-keypair-433145148", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:11.613402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:12.058262 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] validate_networks() for [('f384a833-4d30-4845-aa83-a1cad46c6a6b', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:48:12.482530 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=12 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:12.694385 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-22816659-61cd-48b9-82e9-5e03a641d3cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:12.713845 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-22816659-61cd-48b9-82e9-5e03a641d3cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 2.168800 Aug 12 06:48:12.728535 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:10 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:13.425416 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=16 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:13.908565 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-d3e7ebed-7779-403e-8bf4-e73fd4a6cbde req-3f533dc9-da86-4b22-8587-01a5642a5d83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e", "tag": "3488a7ce-3db5-49eb-97e2-358274ff1714"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:13.950662 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-d3e7ebed-7779-403e-8bf4-e73fd4a6cbde req-3f533dc9-da86-4b22-8587-01a5642a5d83 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:13.951427 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-d3e7ebed-7779-403e-8bf4-e73fd4a6cbde req-3f533dc9-da86-4b22-8587-01a5642a5d83 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:13.952149 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-d3e7ebed-7779-403e-8bf4-e73fd4a6cbde req-3f533dc9-da86-4b22-8587-01a5642a5d83 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:14.005611 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-d3e7ebed-7779-403e-8bf4-e73fd4a6cbde req-3f533dc9-da86-4b22-8587-01a5642a5d83 service nova] Creating event network-changed:3488a7ce-3db5-49eb-97e2-358274ff1714 for instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e on hv-cinder-84457 Aug 12 06:48:14.006168 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-d3e7ebed-7779-403e-8bf4-e73fd4a6cbde req-3f533dc9-da86-4b22-8587-01a5642a5d83 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127087) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 12 06:48:14.006566 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-d3e7ebed-7779-403e-8bf4-e73fd4a6cbde req-3f533dc9-da86-4b22-8587-01a5642a5d83 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127087) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 12 06:48:14.012256 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6375ba72-878b-4e53-a685-90d261ed30fa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:14.012753 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6375ba72-878b-4e53-a685-90d261ed30fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:14.016224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6375ba72-878b-4e53-a685-90d261ed30fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:14.017098 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6375ba72-878b-4e53-a685-90d261ed30fa None None] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:14.020511 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6375ba72-878b-4e53-a685-90d261ed30fa None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:14.021461 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6375ba72-878b-4e53-a685-90d261ed30fa None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:14.041975 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.compute.rpcapi [None req-6375ba72-878b-4e53-a685-90d261ed30fa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 12 06:48:14.049300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6375ba72-878b-4e53-a685-90d261ed30fa None None] Releasing lock "compute-rpcapi-router" {{(pid=127087) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 12 06:48:14.102866 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6375ba72-878b-4e53-a685-90d261ed30fa None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.591963 Aug 12 06:48:14.105925 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 15/26] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:14.120005 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1c47da19-c0d3-4fd3-b382-b6f0d0497a1f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:14.120707 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1c47da19-c0d3-4fd3-b382-b6f0d0497a1f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:14.145792 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1c47da19-c0d3-4fd3-b382-b6f0d0497a1f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:14.146291 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1c47da19-c0d3-4fd3-b382-b6f0d0497a1f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:14.147163 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1c47da19-c0d3-4fd3-b382-b6f0d0497a1f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:14.147894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1c47da19-c0d3-4fd3-b382-b6f0d0497a1f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:14.148348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1c47da19-c0d3-4fd3-b382-b6f0d0497a1f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:14.149053 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1c47da19-c0d3-4fd3-b382-b6f0d0497a1f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:14.566619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:48:14.567120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:48:14.567544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:48:14.567954 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:48:14.568364 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:48:14.584551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:14.585042 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:14.585477 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:14.586208 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:14.586664 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:14.588152 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:14.630362 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for project b89f418ef5fd41b39c0a0a36968da428. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:48:14.635507 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for user 342ef719c63d4fbfa5a2a3943bd3b24b and project b89f418ef5fd41b39c0a0a36968da428. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:48:14.656913 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:48:14.659557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:48:14.722793 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7c159429-59c6-413c-a856-339d2b7bb3a1 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.147957 Aug 12 06:48:14.730329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 12/27] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:48:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 3156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:48:14.805653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1c47da19-c0d3-4fd3-b382-b6f0d0497a1f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:14.823693 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1c47da19-c0d3-4fd3-b382-b6f0d0497a1f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.713348 Aug 12 06:48:14.828290 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 16/28] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:14 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:15.023911 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-556612793", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "networks": [{"uuid": "fba535ca-b837-42a7-b960-3d6fc86c888d"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:15.090548 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-c1e7d1e2-921b-435d-9e25-4af91a6be83c req-dd2a7779-faa0-4d6b-9cb5-4167d8d65f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a023b3c-3e26-4379-b327-e5d86cbf2cae", "tag": "6068429d-1e1c-4e95-a5ef-a47d18e418da"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:15.110097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-c1e7d1e2-921b-435d-9e25-4af91a6be83c req-dd2a7779-faa0-4d6b-9cb5-4167d8d65f48 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:15.114128 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-c1e7d1e2-921b-435d-9e25-4af91a6be83c req-dd2a7779-faa0-4d6b-9cb5-4167d8d65f48 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:15.116155 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-c1e7d1e2-921b-435d-9e25-4af91a6be83c req-dd2a7779-faa0-4d6b-9cb5-4167d8d65f48 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:15.124105 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] validate_networks() for [('fba535ca-b837-42a7-b960-3d6fc86c888d', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:48:15.131814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-c1e7d1e2-921b-435d-9e25-4af91a6be83c req-dd2a7779-faa0-4d6b-9cb5-4167d8d65f48 service nova] Creating event network-changed:6068429d-1e1c-4e95-a5ef-a47d18e418da for instance 6a023b3c-3e26-4379-b327-e5d86cbf2cae on hv-cinder-84457 Aug 12 06:48:15.139183 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-c1e7d1e2-921b-435d-9e25-4af91a6be83c req-dd2a7779-faa0-4d6b-9cb5-4167d8d65f48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.308780 Aug 12 06:48:15.140134 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 17/29] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:15.147185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-540541912", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de62d086-c1e5-4c9e-91ef-840123cf1c0c"}], "security_groups": [{"name": "tempest-securitygroup--769184948"}], "key_name": "tempest-keypair-1691547418", "user_data": "}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:15.692319 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] validate_networks() for [('de62d086-c1e5-4c9e-91ef-840123cf1c0c', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:48:16.744377 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:48:16.744863 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:48:16.745239 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:48:16.745636 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:48:16.746077 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:48:16.748269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=10 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:16.786744 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:16.787278 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:16.792060 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:16.796213 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:16.796704 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:16.797150 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:16.830758 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Getting quotas for project 1efb9fc8b8544edaac9d5dcf5dc18d66. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:48:16.837461 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Getting quotas for user db4d3f63b3b54993b59d69af08d69218 and project 1efb9fc8b8544edaac9d5dcf5dc18d66. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:48:16.854090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:48:16.858277 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:48:16.969307 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c02bf9b1-c692-43ba-b0c8-6e3bbbb4c4a7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.235936 Aug 12 06:48:16.982694 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 13/30] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:48:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:48:16.999427 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f25ae559-392c-4656-b33a-c0be1cb1c5e3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:17.003759 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f25ae559-392c-4656-b33a-c0be1cb1c5e3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:17.028298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f25ae559-392c-4656-b33a-c0be1cb1c5e3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:17.029144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f25ae559-392c-4656-b33a-c0be1cb1c5e3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:17.029803 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f25ae559-392c-4656-b33a-c0be1cb1c5e3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:17.031000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f25ae559-392c-4656-b33a-c0be1cb1c5e3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:17.032415 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f25ae559-392c-4656-b33a-c0be1cb1c5e3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:17.032986 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f25ae559-392c-4656-b33a-c0be1cb1c5e3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:17.589081 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f25ae559-392c-4656-b33a-c0be1cb1c5e3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:17.613993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f25ae559-392c-4656-b33a-c0be1cb1c5e3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1244 microversion: 2.1 time: 0.629652 Aug 12 06:48:17.614619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 14/31] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:16 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1244 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:17.644945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-64852e29-d708-4834-8adb-8893c5ae0c40 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:17.645605 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-64852e29-d708-4834-8adb-8893c5ae0c40 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:17.696836 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64852e29-d708-4834-8adb-8893c5ae0c40 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:17.697482 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64852e29-d708-4834-8adb-8893c5ae0c40 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:17.698114 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64852e29-d708-4834-8adb-8893c5ae0c40 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:17.698854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64852e29-d708-4834-8adb-8893c5ae0c40 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:17.699338 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64852e29-d708-4834-8adb-8893c5ae0c40 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:17.699955 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64852e29-d708-4834-8adb-8893c5ae0c40 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:18.670273 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:48:18.670815 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:48:18.671184 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:48:18.672847 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:48:18.673455 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:48:18.699284 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:18.703148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:18.705596 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:18.710801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:18.714642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:18.716165 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:18.831021 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Getting quotas for project 953a18a150ee420b908ea4c3665811b6. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:48:18.866666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Getting quotas for user 498c574c32a341a59287de043fa0fe3f and project 953a18a150ee420b908ea4c3665811b6. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:48:18.903980 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:48:18.906762 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:48:19.168253 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e4b93ca0-8bf7-4084-941e-fced6901b8e5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.026860 Aug 12 06:48:19.176215 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 18/32] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:48:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 4035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:48:19.181904 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-dade75e8-dee6-4e3a-8030-8e0f5ce0667c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:19.186586 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-dade75e8-dee6-4e3a-8030-8e0f5ce0667c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:19.217355 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dade75e8-dee6-4e3a-8030-8e0f5ce0667c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:19.219532 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dade75e8-dee6-4e3a-8030-8e0f5ce0667c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:19.222298 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dade75e8-dee6-4e3a-8030-8e0f5ce0667c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:19.225124 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dade75e8-dee6-4e3a-8030-8e0f5ce0667c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:19.232237 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dade75e8-dee6-4e3a-8030-8e0f5ce0667c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:19.233466 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dade75e8-dee6-4e3a-8030-8e0f5ce0667c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:19.695192 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dade75e8-dee6-4e3a-8030-8e0f5ce0667c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:19.717404 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-dade75e8-dee6-4e3a-8030-8e0f5ce0667c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1266 microversion: 2.1 time: 0.538852 Aug 12 06:48:19.720327 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 19/33] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:19 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1266 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:19.735476 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1317365998", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af89cb0b-7b5e-40be-9ba4-4c4bd0c46b2b"}], "security_groups": [{"name": "tempest-securitygroup--485265882"}], "key_name": "tempest-keypair-1768940355", "user_data": "}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:20.057088 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-64852e29-d708-4834-8adb-8893c5ae0c40 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:20.064857 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-64852e29-d708-4834-8adb-8893c5ae0c40 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 2.440489 Aug 12 06:48:20.065443 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 15/34] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:17 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 2445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:20.082449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-198ea1b8-1ce9-4368-81fd-6a18a2a940ef tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:20.083087 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-198ea1b8-1ce9-4368-81fd-6a18a2a940ef tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:20.089407 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-198ea1b8-1ce9-4368-81fd-6a18a2a940ef tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:20.089901 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-198ea1b8-1ce9-4368-81fd-6a18a2a940ef tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:20.090336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-198ea1b8-1ce9-4368-81fd-6a18a2a940ef tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:20.091066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-198ea1b8-1ce9-4368-81fd-6a18a2a940ef tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:20.091524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-198ea1b8-1ce9-4368-81fd-6a18a2a940ef tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:20.091954 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-198ea1b8-1ce9-4368-81fd-6a18a2a940ef tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:20.153812 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] validate_networks() for [('af89cb0b-7b5e-40be-9ba4-4c4bd0c46b2b', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:48:20.172749 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-198ea1b8-1ce9-4368-81fd-6a18a2a940ef tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:20.180745 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-198ea1b8-1ce9-4368-81fd-6a18a2a940ef tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1298 microversion: 2.1 time: 0.101942 Aug 12 06:48:20.181433 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 16/35] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:20 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:20.186061 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-24fe1159-81f1-4027-97c9-b13844432e6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:20.186855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-24fe1159-81f1-4027-97c9-b13844432e6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:20.192966 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fe1159-81f1-4027-97c9-b13844432e6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:20.193619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fe1159-81f1-4027-97c9-b13844432e6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:20.194366 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fe1159-81f1-4027-97c9-b13844432e6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:20.195335 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fe1159-81f1-4027-97c9-b13844432e6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:20.195866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fe1159-81f1-4027-97c9-b13844432e6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:20.196363 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fe1159-81f1-4027-97c9-b13844432e6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:20.270631 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-24fe1159-81f1-4027-97c9-b13844432e6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:20.280316 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-24fe1159-81f1-4027-97c9-b13844432e6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1241 microversion: 2.1 time: 0.096009 Aug 12 06:48:20.281815 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 17/36] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:20 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:20.595490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:48:20.596109 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:48:20.596719 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:48:20.597390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:48:20.597903 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:48:20.608017 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:20.608602 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:20.609263 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:20.610147 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:20.610852 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:20.611429 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:20.632005 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Getting quotas for project 9f03ba37e3ca430d8f7777a28b2819d3. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:48:20.636503 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Getting quotas for user 4f4a5b4ebab2440faab418f58b87942f and project 9f03ba37e3ca430d8f7777a28b2819d3. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:48:20.657766 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:48:20.676077 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:48:20.741507 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-72a833cc-bad6-43ae-8039-60b62db805a8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:20.742222 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-72a833cc-bad6-43ae-8039-60b62db805a8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:20.748798 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72a833cc-bad6-43ae-8039-60b62db805a8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:20.749803 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c86211b6-3c8c-4e4c-a7d2-866024065248 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.027492 Aug 12 06:48:20.750273 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72a833cc-bad6-43ae-8039-60b62db805a8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:20.750475 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72a833cc-bad6-43ae-8039-60b62db805a8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:20.751368 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72a833cc-bad6-43ae-8039-60b62db805a8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:20.751854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72a833cc-bad6-43ae-8039-60b62db805a8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:20.752390 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72a833cc-bad6-43ae-8039-60b62db805a8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:20.753101 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 20/37] 10.222.0.20 () {62 vars in 1188 bytes} [Fri Aug 12 06:48:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 12 06:48:20.764785 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-807e2e16-38ab-4551-b147-361cd4caef66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:20.765465 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-807e2e16-38ab-4551-b147-361cd4caef66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:20.832297 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-807e2e16-38ab-4551-b147-361cd4caef66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:20.846121 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-807e2e16-38ab-4551-b147-361cd4caef66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:20.848813 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-807e2e16-38ab-4551-b147-361cd4caef66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:20.849995 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-807e2e16-38ab-4551-b147-361cd4caef66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1282 microversion: 2.20 time: 0.090097 Aug 12 06:48:20.853868 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 21/38] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:20 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:48:20.877953 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-72a833cc-bad6-43ae-8039-60b62db805a8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:20.888223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-72a833cc-bad6-43ae-8039-60b62db805a8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1266 microversion: 2.1 time: 0.151800 Aug 12 06:48:20.899019 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 18/39] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:20 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:21.089239 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e58057a8-5026-4752-bcd4-977c21be8209 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:21.090127 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e58057a8-5026-4752-bcd4-977c21be8209 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:21.105097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e58057a8-5026-4752-bcd4-977c21be8209 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:21.105737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e58057a8-5026-4752-bcd4-977c21be8209 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:21.106220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e58057a8-5026-4752-bcd4-977c21be8209 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:21.106935 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e58057a8-5026-4752-bcd4-977c21be8209 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:21.107500 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e58057a8-5026-4752-bcd4-977c21be8209 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:21.107927 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e58057a8-5026-4752-bcd4-977c21be8209 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:21.204822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3b5b9d8c-7a80-4d98-bf46-6d3e26b8e059 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:21.206013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3b5b9d8c-7a80-4d98-bf46-6d3e26b8e059 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:21.215730 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b5b9d8c-7a80-4d98-bf46-6d3e26b8e059 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:21.218624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b5b9d8c-7a80-4d98-bf46-6d3e26b8e059 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:21.219441 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b5b9d8c-7a80-4d98-bf46-6d3e26b8e059 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:21.221212 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b5b9d8c-7a80-4d98-bf46-6d3e26b8e059 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:21.221881 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b5b9d8c-7a80-4d98-bf46-6d3e26b8e059 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:21.223685 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b5b9d8c-7a80-4d98-bf46-6d3e26b8e059 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:21.338512 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3b5b9d8c-7a80-4d98-bf46-6d3e26b8e059 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:21.348299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3b5b9d8c-7a80-4d98-bf46-6d3e26b8e059 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1298 microversion: 2.1 time: 0.149398 Aug 12 06:48:21.348824 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 19/40] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:21 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:21.355955 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0ba3b2b8-a09d-41ec-95bd-8fbcc43db71e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:21.356567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0ba3b2b8-a09d-41ec-95bd-8fbcc43db71e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:21.382847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2b8-a09d-41ec-95bd-8fbcc43db71e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:21.383787 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2b8-a09d-41ec-95bd-8fbcc43db71e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:21.384432 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2b8-a09d-41ec-95bd-8fbcc43db71e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:21.386909 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2b8-a09d-41ec-95bd-8fbcc43db71e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:21.388117 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2b8-a09d-41ec-95bd-8fbcc43db71e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:21.388834 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ba3b2b8-a09d-41ec-95bd-8fbcc43db71e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:21.406105 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e58057a8-5026-4752-bcd4-977c21be8209 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:21.421137 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e58057a8-5026-4752-bcd4-977c21be8209 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.336294 Aug 12 06:48:21.431062 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:21 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:21.488337 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0ba3b2b8-a09d-41ec-95bd-8fbcc43db71e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:21.499955 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0ba3b2b8-a09d-41ec-95bd-8fbcc43db71e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1241 microversion: 2.1 time: 0.147463 Aug 12 06:48:21.500541 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 20/42] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:21 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:21.872940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:21.873542 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:21.879777 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:21.880247 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:21.880674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:21.881524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:21.881975 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:21.882397 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:21.912406 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ab919aa4-0da6-4177-97b7-8203c917a285 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:21.913437 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ab919aa4-0da6-4177-97b7-8203c917a285 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:21.923625 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab919aa4-0da6-4177-97b7-8203c917a285 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:21.924485 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab919aa4-0da6-4177-97b7-8203c917a285 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:21.925422 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab919aa4-0da6-4177-97b7-8203c917a285 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:21.927104 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab919aa4-0da6-4177-97b7-8203c917a285 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:21.927801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab919aa4-0da6-4177-97b7-8203c917a285 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:21.928421 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab919aa4-0da6-4177-97b7-8203c917a285 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:21.964475 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:21.973767 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:21.975307 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:21.976414 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b510ff91-abe6-48e4-8d95-ef9c1f7d6357 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1286 microversion: 2.20 time: 0.107573 Aug 12 06:48:21.983801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 23/43] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:21 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:22.024807 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ab919aa4-0da6-4177-97b7-8203c917a285 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:22.035925 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ab919aa4-0da6-4177-97b7-8203c917a285 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1266 microversion: 2.1 time: 0.129730 Aug 12 06:48:22.037047 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 21/44] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:21 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:22.385843 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ecc52cb1-2681-4105-a5f0-30d862201d65 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:22.386542 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ecc52cb1-2681-4105-a5f0-30d862201d65 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:22.394355 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecc52cb1-2681-4105-a5f0-30d862201d65 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:22.395524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecc52cb1-2681-4105-a5f0-30d862201d65 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:22.396239 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecc52cb1-2681-4105-a5f0-30d862201d65 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:22.397840 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecc52cb1-2681-4105-a5f0-30d862201d65 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:22.398445 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecc52cb1-2681-4105-a5f0-30d862201d65 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:22.398878 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecc52cb1-2681-4105-a5f0-30d862201d65 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:22.447514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f02c342b-2597-4ff2-8b34-eb5024327df8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:22.449916 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f02c342b-2597-4ff2-8b34-eb5024327df8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:22.458840 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f02c342b-2597-4ff2-8b34-eb5024327df8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:22.460097 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f02c342b-2597-4ff2-8b34-eb5024327df8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:22.461006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f02c342b-2597-4ff2-8b34-eb5024327df8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:22.462127 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f02c342b-2597-4ff2-8b34-eb5024327df8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:22.462782 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f02c342b-2597-4ff2-8b34-eb5024327df8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:22.463904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f02c342b-2597-4ff2-8b34-eb5024327df8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:22.502784 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ecc52cb1-2681-4105-a5f0-30d862201d65 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:22.521136 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ecc52cb1-2681-4105-a5f0-30d862201d65 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1298 microversion: 2.1 time: 0.139509 Aug 12 06:48:22.531763 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 24/45] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:22 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1298 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:22.531763 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9299973f-ba66-453e-9ae2-62127e8f5f06 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:22.531763 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9299973f-ba66-453e-9ae2-62127e8f5f06 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:22.537212 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9299973f-ba66-453e-9ae2-62127e8f5f06 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:22.537212 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9299973f-ba66-453e-9ae2-62127e8f5f06 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:22.537212 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9299973f-ba66-453e-9ae2-62127e8f5f06 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:22.537657 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9299973f-ba66-453e-9ae2-62127e8f5f06 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:22.538265 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9299973f-ba66-453e-9ae2-62127e8f5f06 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:22.538782 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9299973f-ba66-453e-9ae2-62127e8f5f06 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:22.625445 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9299973f-ba66-453e-9ae2-62127e8f5f06 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:22.634943 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9299973f-ba66-453e-9ae2-62127e8f5f06 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1241 microversion: 2.1 time: 0.110421 Aug 12 06:48:22.636443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 25/46] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:22 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:22.668237 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f02c342b-2597-4ff2-8b34-eb5024327df8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:22.676202 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f02c342b-2597-4ff2-8b34-eb5024327df8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.235943 Aug 12 06:48:22.676877 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 22/47] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:22 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:23.006191 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:23.006897 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:23.014389 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:23.015447 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:23.021541 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:23.022596 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:23.023092 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:23.023764 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:23.057116 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e1d9250a-3191-4e77-ade8-840e0add6f26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:23.057723 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e1d9250a-3191-4e77-ade8-840e0add6f26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:23.067809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d9250a-3191-4e77-ade8-840e0add6f26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:23.068667 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d9250a-3191-4e77-ade8-840e0add6f26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:23.069107 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d9250a-3191-4e77-ade8-840e0add6f26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:23.069817 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d9250a-3191-4e77-ade8-840e0add6f26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:23.070361 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d9250a-3191-4e77-ade8-840e0add6f26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:23.070675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d9250a-3191-4e77-ade8-840e0add6f26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:23.153528 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:23.163620 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:23.165282 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:23.166361 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ddedd1e0-794d-4bab-84f9-77629dcfe3a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1286 microversion: 2.20 time: 0.164810 Aug 12 06:48:23.166933 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 26/48] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:23 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1286 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:23.367241 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e1d9250a-3191-4e77-ade8-840e0add6f26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:23.376555 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e1d9250a-3191-4e77-ade8-840e0add6f26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1266 microversion: 2.1 time: 0.321991 Aug 12 06:48:23.379618 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 23/49] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:23 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:23.545521 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-611a51f5-b6d3-4ed4-a60f-d25f58a94090 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:23.546214 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-611a51f5-b6d3-4ed4-a60f-d25f58a94090 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:23.549734 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:23.559786 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-611a51f5-b6d3-4ed4-a60f-d25f58a94090 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:23.565593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-611a51f5-b6d3-4ed4-a60f-d25f58a94090 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:23.566278 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-611a51f5-b6d3-4ed4-a60f-d25f58a94090 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:23.567340 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-611a51f5-b6d3-4ed4-a60f-d25f58a94090 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:23.567965 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-611a51f5-b6d3-4ed4-a60f-d25f58a94090 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:23.568589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-611a51f5-b6d3-4ed4-a60f-d25f58a94090 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:23.664338 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b11dfceb-ae6a-447a-a10e-79a25eb92e7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:23.665048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b11dfceb-ae6a-447a-a10e-79a25eb92e7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:23.672325 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b11dfceb-ae6a-447a-a10e-79a25eb92e7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:23.672822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b11dfceb-ae6a-447a-a10e-79a25eb92e7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:23.674184 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b11dfceb-ae6a-447a-a10e-79a25eb92e7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:23.675429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b11dfceb-ae6a-447a-a10e-79a25eb92e7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:23.675983 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b11dfceb-ae6a-447a-a10e-79a25eb92e7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:23.680512 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b11dfceb-ae6a-447a-a10e-79a25eb92e7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:23.704151 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-611a51f5-b6d3-4ed4-a60f-d25f58a94090 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:23.714328 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-611a51f5-b6d3-4ed4-a60f-d25f58a94090 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1298 microversion: 2.1 time: 0.173175 Aug 12 06:48:23.727551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 27/50] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:23 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:23.734137 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5318f5c6-461d-4413-a04a-4bffcd790429 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:23.735315 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5318f5c6-461d-4413-a04a-4bffcd790429 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:23.760303 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5318f5c6-461d-4413-a04a-4bffcd790429 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:23.760882 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5318f5c6-461d-4413-a04a-4bffcd790429 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:23.761609 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5318f5c6-461d-4413-a04a-4bffcd790429 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:23.762471 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5318f5c6-461d-4413-a04a-4bffcd790429 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:23.763136 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5318f5c6-461d-4413-a04a-4bffcd790429 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:23.763721 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5318f5c6-461d-4413-a04a-4bffcd790429 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:23.821426 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b11dfceb-ae6a-447a-a10e-79a25eb92e7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:23.834145 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b11dfceb-ae6a-447a-a10e-79a25eb92e7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1289 microversion: 2.1 time: 0.180729 Aug 12 06:48:23.837090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 24/51] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:23 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1289 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:24.193999 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:24.195430 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:24.207968 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:24.211603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:24.212168 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:24.214665 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:24.215724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:24.216802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:24.246710 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5318f5c6-461d-4413-a04a-4bffcd790429 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:24.256387 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5318f5c6-461d-4413-a04a-4bffcd790429 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.527165 Aug 12 06:48:24.258870 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 28/52] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:23 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:24.353058 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:24.374123 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:24.376279 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:24.377808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c2526481-8b10-41e6-83e0-ccc3c683f1bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1342 microversion: 2.20 time: 0.190721 Aug 12 06:48:24.378866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 25/53] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:24 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1342 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:24.406415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b28edf2b-4397-497d-b35d-a6740b38b75b tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:24.408085 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b28edf2b-4397-497d-b35d-a6740b38b75b tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:24.415474 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b28edf2b-4397-497d-b35d-a6740b38b75b tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:24.416110 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b28edf2b-4397-497d-b35d-a6740b38b75b tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:24.416594 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b28edf2b-4397-497d-b35d-a6740b38b75b tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:24.418265 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b28edf2b-4397-497d-b35d-a6740b38b75b tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:24.418893 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b28edf2b-4397-497d-b35d-a6740b38b75b tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:24.419327 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b28edf2b-4397-497d-b35d-a6740b38b75b tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:24.544026 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b28edf2b-4397-497d-b35d-a6740b38b75b tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:24.552170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b28edf2b-4397-497d-b35d-a6740b38b75b tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1272 microversion: 2.1 time: 0.154005 Aug 12 06:48:24.553280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 29/54] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:24 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:24.739954 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4c8503d3-06fa-4528-a93d-c00ee650f745 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:24.741307 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4c8503d3-06fa-4528-a93d-c00ee650f745 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:24.748606 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c8503d3-06fa-4528-a93d-c00ee650f745 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:24.749450 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c8503d3-06fa-4528-a93d-c00ee650f745 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:24.750091 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c8503d3-06fa-4528-a93d-c00ee650f745 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:24.750952 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c8503d3-06fa-4528-a93d-c00ee650f745 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:24.751563 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c8503d3-06fa-4528-a93d-c00ee650f745 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:24.752160 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c8503d3-06fa-4528-a93d-c00ee650f745 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:24.762792 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:24.843868 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4c8503d3-06fa-4528-a93d-c00ee650f745 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:24.860722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-85f972a0-c433-4ce4-9e18-24c0ec7e3531 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:24.861703 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-85f972a0-c433-4ce4-9e18-24c0ec7e3531 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:24.872364 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4c8503d3-06fa-4528-a93d-c00ee650f745 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1298 microversion: 2.1 time: 0.135214 Aug 12 06:48:24.873120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 26/55] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:24 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:24.874412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85f972a0-c433-4ce4-9e18-24c0ec7e3531 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:24.875849 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85f972a0-c433-4ce4-9e18-24c0ec7e3531 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:24.876411 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85f972a0-c433-4ce4-9e18-24c0ec7e3531 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:24.884106 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85f972a0-c433-4ce4-9e18-24c0ec7e3531 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:24.886232 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85f972a0-c433-4ce4-9e18-24c0ec7e3531 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:24.889970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85f972a0-c433-4ce4-9e18-24c0ec7e3531 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:24.991028 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-85f972a0-c433-4ce4-9e18-24c0ec7e3531 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:24.994504 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:24.999757 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-85f972a0-c433-4ce4-9e18-24c0ec7e3531 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1289 microversion: 2.1 time: 0.147349 Aug 12 06:48:25.013071 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 30/56] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:24 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1289 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:25.290417 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2ed1e817-19ea-4a30-8655-24236d88fc16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:25.291164 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2ed1e817-19ea-4a30-8655-24236d88fc16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:25.310329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ed1e817-19ea-4a30-8655-24236d88fc16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:25.310329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ed1e817-19ea-4a30-8655-24236d88fc16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:25.316892 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ed1e817-19ea-4a30-8655-24236d88fc16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:25.320664 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ed1e817-19ea-4a30-8655-24236d88fc16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:25.321228 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ed1e817-19ea-4a30-8655-24236d88fc16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:25.323372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ed1e817-19ea-4a30-8655-24236d88fc16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:25.407891 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:25.408751 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:25.423122 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:25.423122 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:25.426108 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:25.429178 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:25.434368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:25.436254 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:26.078055 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:26.091086 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:26.095122 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:26.096327 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b4f5ee01-6e7a-455c-948b-76cf91b60cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1352 microversion: 2.20 time: 0.693724 Aug 12 06:48:26.099199 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 31/57] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:25 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1352 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:26.110156 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-26822aa2-a940-4d5d-b000-380567e11f56 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:26.113268 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-26822aa2-a940-4d5d-b000-380567e11f56 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:26.124821 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26822aa2-a940-4d5d-b000-380567e11f56 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:26.131464 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26822aa2-a940-4d5d-b000-380567e11f56 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:26.131977 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26822aa2-a940-4d5d-b000-380567e11f56 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:26.132719 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26822aa2-a940-4d5d-b000-380567e11f56 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:26.133177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26822aa2-a940-4d5d-b000-380567e11f56 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:26.133597 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26822aa2-a940-4d5d-b000-380567e11f56 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:26.421450 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2ed1e817-19ea-4a30-8655-24236d88fc16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:26.430901 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2ed1e817-19ea-4a30-8655-24236d88fc16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 1.154845 Aug 12 06:48:26.445511 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 27/58] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:25 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:26.453320 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e2eceeb9-08a2-4a78-b35c-394919bceb32 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:26.454189 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e2eceeb9-08a2-4a78-b35c-394919bceb32 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:26.462186 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2eceeb9-08a2-4a78-b35c-394919bceb32 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:26.463425 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2eceeb9-08a2-4a78-b35c-394919bceb32 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:26.463724 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-26822aa2-a940-4d5d-b000-380567e11f56 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:26.464643 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2eceeb9-08a2-4a78-b35c-394919bceb32 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:26.465608 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2eceeb9-08a2-4a78-b35c-394919bceb32 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:26.467544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2eceeb9-08a2-4a78-b35c-394919bceb32 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:26.468171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2eceeb9-08a2-4a78-b35c-394919bceb32 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:26.474689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-26822aa2-a940-4d5d-b000-380567e11f56 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.371748 Aug 12 06:48:26.475332 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 32/59] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:26 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:26.484701 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0498b63c-1d45-4d5d-819b-347a1f971e76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:26.485659 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0498b63c-1d45-4d5d-819b-347a1f971e76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:26.502406 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0498b63c-1d45-4d5d-819b-347a1f971e76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:26.503163 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0498b63c-1d45-4d5d-819b-347a1f971e76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:26.507439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0498b63c-1d45-4d5d-819b-347a1f971e76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:26.510568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0498b63c-1d45-4d5d-819b-347a1f971e76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:26.512051 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0498b63c-1d45-4d5d-819b-347a1f971e76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:26.512620 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0498b63c-1d45-4d5d-819b-347a1f971e76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:26.623522 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0498b63c-1d45-4d5d-819b-347a1f971e76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:26.632238 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0498b63c-1d45-4d5d-819b-347a1f971e76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1295 microversion: 2.1 time: 0.153764 Aug 12 06:48:26.633824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 33/60] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:26 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1295 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:26.770790 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e2eceeb9-08a2-4a78-b35c-394919bceb32 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:26.786969 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e2eceeb9-08a2-4a78-b35c-394919bceb32 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.337970 Aug 12 06:48:26.788176 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 28/61] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:26 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:27.062690 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-3241e49c-dfa3-467d-9f08-72240df1709a req-dc7cf102-9e7c-4c17-9631-fceb0b45ae44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5e7e6c-f576-47c1-8fb5-407e318d15c4", "tag": "27e18af9-c038-4192-b7a5-a893995402b0"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:27.079609 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3241e49c-dfa3-467d-9f08-72240df1709a req-dc7cf102-9e7c-4c17-9631-fceb0b45ae44 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:27.080388 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3241e49c-dfa3-467d-9f08-72240df1709a req-dc7cf102-9e7c-4c17-9631-fceb0b45ae44 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:27.081544 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3241e49c-dfa3-467d-9f08-72240df1709a req-dc7cf102-9e7c-4c17-9631-fceb0b45ae44 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:27.098111 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-3241e49c-dfa3-467d-9f08-72240df1709a req-dc7cf102-9e7c-4c17-9631-fceb0b45ae44 service nova] Creating event network-changed:27e18af9-c038-4192-b7a5-a893995402b0 for instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 on hv-cinder-84457 Aug 12 06:48:27.104629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-3241e49c-dfa3-467d-9f08-72240df1709a req-dc7cf102-9e7c-4c17-9631-fceb0b45ae44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049341 Aug 12 06:48:27.105634 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 34/62] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:27.125383 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:27.125993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:27.128018 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:27.128718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=12 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:27.137208 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:27.137692 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:27.138103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:27.138809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:27.139278 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:27.139704 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:27.219649 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:27.231565 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:27.233424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:27.234600 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8552d825-00ae-4d6c-9a14-2a9325006586 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1340 microversion: 2.20 time: 0.113139 Aug 12 06:48:27.235649 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 29/63] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:27 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1340 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:27.456269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-dc551cc5-4bb2-4e53-9297-6e41b0083998 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:27.457065 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-dc551cc5-4bb2-4e53-9297-6e41b0083998 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:27.464439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc551cc5-4bb2-4e53-9297-6e41b0083998 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:27.465655 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc551cc5-4bb2-4e53-9297-6e41b0083998 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:27.466466 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc551cc5-4bb2-4e53-9297-6e41b0083998 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:27.467682 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc551cc5-4bb2-4e53-9297-6e41b0083998 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:27.468308 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc551cc5-4bb2-4e53-9297-6e41b0083998 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:27.469177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc551cc5-4bb2-4e53-9297-6e41b0083998 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:27.504024 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-68091bfd-bb5b-4cdb-b84a-7176f1257264 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:27.505431 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-68091bfd-bb5b-4cdb-b84a-7176f1257264 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:27.517081 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68091bfd-bb5b-4cdb-b84a-7176f1257264 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:27.518648 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68091bfd-bb5b-4cdb-b84a-7176f1257264 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:27.519189 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68091bfd-bb5b-4cdb-b84a-7176f1257264 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:27.520179 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68091bfd-bb5b-4cdb-b84a-7176f1257264 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:27.521316 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68091bfd-bb5b-4cdb-b84a-7176f1257264 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:27.522337 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68091bfd-bb5b-4cdb-b84a-7176f1257264 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:27.719472 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dc551cc5-4bb2-4e53-9297-6e41b0083998 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:27.727180 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-dc551cc5-4bb2-4e53-9297-6e41b0083998 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.277319 Aug 12 06:48:27.727781 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 35/64] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:27 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:27.731945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-68091bfd-bb5b-4cdb-b84a-7176f1257264 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:27.732183 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8ae2a995-5e1d-406c-b7ef-62de7310739d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:27.732778 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8ae2a995-5e1d-406c-b7ef-62de7310739d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:27.738798 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ae2a995-5e1d-406c-b7ef-62de7310739d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:27.739309 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ae2a995-5e1d-406c-b7ef-62de7310739d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:27.739736 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ae2a995-5e1d-406c-b7ef-62de7310739d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:27.739976 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-68091bfd-bb5b-4cdb-b84a-7176f1257264 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.244873 Aug 12 06:48:27.740422 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ae2a995-5e1d-406c-b7ef-62de7310739d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:27.740777 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 30/65] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:27 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:27.740934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ae2a995-5e1d-406c-b7ef-62de7310739d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:27.741287 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ae2a995-5e1d-406c-b7ef-62de7310739d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:27.801279 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8ae2a995-5e1d-406c-b7ef-62de7310739d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:27.808414 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-375444fa-505e-4493-b5f9-9cc122f74a0c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:27.809032 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-375444fa-505e-4493-b5f9-9cc122f74a0c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:27.809161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8ae2a995-5e1d-406c-b7ef-62de7310739d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1295 microversion: 2.1 time: 0.080370 Aug 12 06:48:27.809698 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 36/66] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:27 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1295 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:27.815175 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-375444fa-505e-4493-b5f9-9cc122f74a0c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:27.815612 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-375444fa-505e-4493-b5f9-9cc122f74a0c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:27.816036 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-375444fa-505e-4493-b5f9-9cc122f74a0c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:27.816708 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-375444fa-505e-4493-b5f9-9cc122f74a0c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:27.817345 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-375444fa-505e-4493-b5f9-9cc122f74a0c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:27.817541 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-375444fa-505e-4493-b5f9-9cc122f74a0c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:27.944037 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-375444fa-505e-4493-b5f9-9cc122f74a0c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:27.951603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-375444fa-505e-4493-b5f9-9cc122f74a0c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.146998 Aug 12 06:48:27.952170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 31/67] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:27 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:28.258497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:28.259144 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:28.265615 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:28.266095 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:28.266523 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:28.267255 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:28.267727 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:28.268119 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:28.332929 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:28.340994 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:28.342485 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:28.343666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a83b0a1f-0211-4b0c-a8f5-14c55aa9f3e1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1340 microversion: 2.20 time: 0.089242 Aug 12 06:48:28.344275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 37/68] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:28 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1340 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:28.749737 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3947abae-0d04-43d2-b62c-10648f82dc50 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:28.751200 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3947abae-0d04-43d2-b62c-10648f82dc50 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:28.763409 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ee4bb459-c03c-4729-82a4-8a315d1d6982 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:28.763942 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ee4bb459-c03c-4729-82a4-8a315d1d6982 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:28.765289 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3947abae-0d04-43d2-b62c-10648f82dc50 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:28.766147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3947abae-0d04-43d2-b62c-10648f82dc50 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:28.766801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3947abae-0d04-43d2-b62c-10648f82dc50 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:28.774733 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3947abae-0d04-43d2-b62c-10648f82dc50 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:28.776453 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3947abae-0d04-43d2-b62c-10648f82dc50 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:28.776936 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee4bb459-c03c-4729-82a4-8a315d1d6982 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:28.777203 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3947abae-0d04-43d2-b62c-10648f82dc50 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:28.777434 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee4bb459-c03c-4729-82a4-8a315d1d6982 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:28.777868 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee4bb459-c03c-4729-82a4-8a315d1d6982 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:28.778636 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee4bb459-c03c-4729-82a4-8a315d1d6982 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:28.779132 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee4bb459-c03c-4729-82a4-8a315d1d6982 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:28.784806 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee4bb459-c03c-4729-82a4-8a315d1d6982 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:29.299072 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3947abae-0d04-43d2-b62c-10648f82dc50 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:29.312990 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3947abae-0d04-43d2-b62c-10648f82dc50 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.568329 Aug 12 06:48:29.317541 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 32/69] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:28 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:29.321903 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ee4bb459-c03c-4729-82a4-8a315d1d6982 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:29.337827 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ee4bb459-c03c-4729-82a4-8a315d1d6982 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.581352 Aug 12 06:48:29.340239 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 38/70] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:28 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:29.345248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b6da279b-8545-4146-bdf1-7cb78b2d0139 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:29.347258 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b6da279b-8545-4146-bdf1-7cb78b2d0139 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:29.351383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f1a9f6a8-b740-4177-b4b0-79b5d919c928 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:29.353589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f1a9f6a8-b740-4177-b4b0-79b5d919c928 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:29.362203 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6da279b-8545-4146-bdf1-7cb78b2d0139 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:29.368240 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6da279b-8545-4146-bdf1-7cb78b2d0139 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:29.368883 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6da279b-8545-4146-bdf1-7cb78b2d0139 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:29.371050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6da279b-8545-4146-bdf1-7cb78b2d0139 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:29.371704 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6da279b-8545-4146-bdf1-7cb78b2d0139 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:29.374005 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6da279b-8545-4146-bdf1-7cb78b2d0139 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:29.376940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f1a9f6a8-b740-4177-b4b0-79b5d919c928 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:29.377653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f1a9f6a8-b740-4177-b4b0-79b5d919c928 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:29.378401 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f1a9f6a8-b740-4177-b4b0-79b5d919c928 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:29.380272 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f1a9f6a8-b740-4177-b4b0-79b5d919c928 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:29.383594 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f1a9f6a8-b740-4177-b4b0-79b5d919c928 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:29.384199 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f1a9f6a8-b740-4177-b4b0-79b5d919c928 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:29.525795 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b6da279b-8545-4146-bdf1-7cb78b2d0139 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:29.535257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b6da279b-8545-4146-bdf1-7cb78b2d0139 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1295 microversion: 2.1 time: 0.201953 Aug 12 06:48:29.536691 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 33/71] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:29 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1295 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:29.550365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:29.551067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:29.558227 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:29.559059 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:29.559703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:29.561905 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:29.562439 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:29.563011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:29.850262 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:29.860088 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:29.861615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:29.862772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-19b78547-010b-4fc1-b372-b63435ff99e4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1340 microversion: 2.20 time: 0.318042 Aug 12 06:48:29.863547 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 34/72] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:29 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1340 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:29.904866 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f1a9f6a8-b740-4177-b4b0-79b5d919c928 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:29.921621 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f1a9f6a8-b740-4177-b4b0-79b5d919c928 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.579607 Aug 12 06:48:29.922551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 39/73] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:29 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:30.343718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-92551d90-46c6-4d66-8021-1cb8fd2b7c6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:30.343718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-92551d90-46c6-4d66-8021-1cb8fd2b7c6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:30.352063 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92551d90-46c6-4d66-8021-1cb8fd2b7c6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:30.352551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92551d90-46c6-4d66-8021-1cb8fd2b7c6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:30.353034 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92551d90-46c6-4d66-8021-1cb8fd2b7c6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:30.354363 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92551d90-46c6-4d66-8021-1cb8fd2b7c6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:30.360499 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9990a278-2863-4e62-b0e4-106a0318f8e3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:30.361150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9990a278-2863-4e62-b0e4-106a0318f8e3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:30.367889 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9990a278-2863-4e62-b0e4-106a0318f8e3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:30.368366 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9990a278-2863-4e62-b0e4-106a0318f8e3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:30.368988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92551d90-46c6-4d66-8021-1cb8fd2b7c6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:30.369458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92551d90-46c6-4d66-8021-1cb8fd2b7c6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:30.375668 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9990a278-2863-4e62-b0e4-106a0318f8e3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:30.378749 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9990a278-2863-4e62-b0e4-106a0318f8e3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:30.380485 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9990a278-2863-4e62-b0e4-106a0318f8e3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:30.384020 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9990a278-2863-4e62-b0e4-106a0318f8e3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:30.618752 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:30.836505 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=14 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:30.849756 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92551d90-46c6-4d66-8021-1cb8fd2b7c6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:30.857766 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-92551d90-46c6-4d66-8021-1cb8fd2b7c6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.521041 Aug 12 06:48:30.864567 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9990a278-2863-4e62-b0e4-106a0318f8e3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:30.881352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 35/74] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:30 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:30.885509 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9990a278-2863-4e62-b0e4-106a0318f8e3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.529200 Aug 12 06:48:30.885669 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-286722b8-8c4b-4881-b1e6-508638b27e5d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:30.886204 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-286722b8-8c4b-4881-b1e6-508638b27e5d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:30.886564 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 40/75] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:30 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:30.891291 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:30.894064 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-286722b8-8c4b-4881-b1e6-508638b27e5d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:30.894552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-286722b8-8c4b-4881-b1e6-508638b27e5d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:30.895006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-286722b8-8c4b-4881-b1e6-508638b27e5d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:30.895710 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-286722b8-8c4b-4881-b1e6-508638b27e5d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:30.896158 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-286722b8-8c4b-4881-b1e6-508638b27e5d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:30.896575 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-286722b8-8c4b-4881-b1e6-508638b27e5d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:30.899814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:30.907010 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:30.919742 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:30.920227 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:30.920911 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:30.921362 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:30.921776 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:31.666897 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-286722b8-8c4b-4881-b1e6-508638b27e5d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:31.674647 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-286722b8-8c4b-4881-b1e6-508638b27e5d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.803963 Aug 12 06:48:31.675268 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 36/76] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:30 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:31.685744 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-144ca202-7ae7-45bb-96fe-3e6c0e4207d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:31.688532 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-144ca202-7ae7-45bb-96fe-3e6c0e4207d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:31.703832 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144ca202-7ae7-45bb-96fe-3e6c0e4207d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:31.704324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144ca202-7ae7-45bb-96fe-3e6c0e4207d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:31.704757 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144ca202-7ae7-45bb-96fe-3e6c0e4207d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:31.705514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144ca202-7ae7-45bb-96fe-3e6c0e4207d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:31.705970 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144ca202-7ae7-45bb-96fe-3e6c0e4207d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:31.706390 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144ca202-7ae7-45bb-96fe-3e6c0e4207d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:31.862431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:31.873385 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:31.876006 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:31.880085 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b45972aa-1e53-4f09-a940-80224fdae5fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.991160 Aug 12 06:48:31.880861 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 41/77] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:30 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:31.973524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-144ca202-7ae7-45bb-96fe-3e6c0e4207d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:31.981814 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-144ca202-7ae7-45bb-96fe-3e6c0e4207d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.305396 Aug 12 06:48:31.983106 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 37/78] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:31 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:31.988420 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-cfc01f38-d9bb-42af-b846-60e92776a0f7 req-e6ce139e-c3a7-4eef-9782-336e4e5b7c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67edb8b-4485-4696-9f6a-bb7138745e8a", "tag": "13351888-408a-44b4-b929-ce7da277b2ea"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:32.002065 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cfc01f38-d9bb-42af-b846-60e92776a0f7 req-e6ce139e-c3a7-4eef-9782-336e4e5b7c0e service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.002543 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cfc01f38-d9bb-42af-b846-60e92776a0f7 req-e6ce139e-c3a7-4eef-9782-336e4e5b7c0e service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.003045 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cfc01f38-d9bb-42af-b846-60e92776a0f7 req-e6ce139e-c3a7-4eef-9782-336e4e5b7c0e service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.024962 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-cfc01f38-d9bb-42af-b846-60e92776a0f7 req-e6ce139e-c3a7-4eef-9782-336e4e5b7c0e service nova] Creating event network-changed:13351888-408a-44b4-b929-ce7da277b2ea for instance d67edb8b-4485-4696-9f6a-bb7138745e8a on hv-cinder-84457 Aug 12 06:48:32.025648 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cfc01f38-d9bb-42af-b846-60e92776a0f7 req-e6ce139e-c3a7-4eef-9782-336e4e5b7c0e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 12 06:48:32.026033 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cfc01f38-d9bb-42af-b846-60e92776a0f7 req-e6ce139e-c3a7-4eef-9782-336e4e5b7c0e service nova] Acquired lock "compute-rpcapi-router" {{(pid=127088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 12 06:48:32.027071 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d122f992-7ca3-4dc5-a3f6-14413a049fdc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.027521 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d122f992-7ca3-4dc5-a3f6-14413a049fdc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.027968 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d122f992-7ca3-4dc5-a3f6-14413a049fdc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.028659 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d122f992-7ca3-4dc5-a3f6-14413a049fdc None None] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.029419 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d122f992-7ca3-4dc5-a3f6-14413a049fdc None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.030042 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d122f992-7ca3-4dc5-a3f6-14413a049fdc None None] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.040893 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.compute.rpcapi [None req-d122f992-7ca3-4dc5-a3f6-14413a049fdc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 12 06:48:32.041792 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d122f992-7ca3-4dc5-a3f6-14413a049fdc None None] Releasing lock "compute-rpcapi-router" {{(pid=127088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 12 06:48:32.045849 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-574458e3-0b18-413c-b0d9-5dcc25b763dc req-96bd597a-4579-47b3-ad72-05be07473c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e", "name": "network-vif-plugged", "status": "completed", "tag": "3488a7ce-3db5-49eb-97e2-358274ff1714"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:32.056603 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-574458e3-0b18-413c-b0d9-5dcc25b763dc req-96bd597a-4579-47b3-ad72-05be07473c47 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.057213 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-574458e3-0b18-413c-b0d9-5dcc25b763dc req-96bd597a-4579-47b3-ad72-05be07473c47 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.057743 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-574458e3-0b18-413c-b0d9-5dcc25b763dc req-96bd597a-4579-47b3-ad72-05be07473c47 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.058796 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d122f992-7ca3-4dc5-a3f6-14413a049fdc None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073783 Aug 12 06:48:32.059853 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 38/79] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:32.068280 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2108feb3-2e74-4218-bcf8-d4a6beabdf87 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:32.069295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2108feb3-2e74-4218-bcf8-d4a6beabdf87 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:32.071598 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-574458e3-0b18-413c-b0d9-5dcc25b763dc req-96bd597a-4579-47b3-ad72-05be07473c47 service nova] Creating event network-vif-plugged:3488a7ce-3db5-49eb-97e2-358274ff1714 for instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e on hv-cinder-84457 Aug 12 06:48:32.076809 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-574458e3-0b18-413c-b0d9-5dcc25b763dc req-96bd597a-4579-47b3-ad72-05be07473c47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194606 Aug 12 06:48:32.077550 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 42/80] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:32.081222 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2108feb3-2e74-4218-bcf8-d4a6beabdf87 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.081920 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2108feb3-2e74-4218-bcf8-d4a6beabdf87 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.082361 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2108feb3-2e74-4218-bcf8-d4a6beabdf87 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.083310 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2108feb3-2e74-4218-bcf8-d4a6beabdf87 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.083822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2108feb3-2e74-4218-bcf8-d4a6beabdf87 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.084412 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2108feb3-2e74-4218-bcf8-d4a6beabdf87 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.085164 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-75ea44f4-9495-4327-b1c6-1b7d749f5a06 req-b76309a8-482b-435c-a786-3af89eb7885e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6cd9b2-0e48-4ace-96c2-ba691c366ae1", "tag": "3e7b26bb-9495-4cbe-a8c3-ab4dc50cc862"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:32.094860 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-75ea44f4-9495-4327-b1c6-1b7d749f5a06 req-b76309a8-482b-435c-a786-3af89eb7885e service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.095557 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-75ea44f4-9495-4327-b1c6-1b7d749f5a06 req-b76309a8-482b-435c-a786-3af89eb7885e service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.096082 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-75ea44f4-9495-4327-b1c6-1b7d749f5a06 req-b76309a8-482b-435c-a786-3af89eb7885e service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.107367 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-75ea44f4-9495-4327-b1c6-1b7d749f5a06 req-b76309a8-482b-435c-a786-3af89eb7885e service nova] Creating event network-changed:3e7b26bb-9495-4cbe-a8c3-ab4dc50cc862 for instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 on hv-cinder-84457 Aug 12 06:48:32.112417 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-75ea44f4-9495-4327-b1c6-1b7d749f5a06 req-b76309a8-482b-435c-a786-3af89eb7885e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033381 Aug 12 06:48:32.113140 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 43/81] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:32.118900 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-17ab2065-ad9c-431c-864b-747812863697 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:32.119836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-17ab2065-ad9c-431c-864b-747812863697 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:32.128389 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17ab2065-ad9c-431c-864b-747812863697 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.128949 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17ab2065-ad9c-431c-864b-747812863697 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.129537 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17ab2065-ad9c-431c-864b-747812863697 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.130240 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17ab2065-ad9c-431c-864b-747812863697 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.130685 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17ab2065-ad9c-431c-864b-747812863697 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.131416 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17ab2065-ad9c-431c-864b-747812863697 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.280453 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2108feb3-2e74-4218-bcf8-d4a6beabdf87 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:32.288941 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2108feb3-2e74-4218-bcf8-d4a6beabdf87 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.226742 Aug 12 06:48:32.298363 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 39/82] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:32 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:32.319239 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-17ab2065-ad9c-431c-864b-747812863697 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:32.327255 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-17ab2065-ad9c-431c-864b-747812863697 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.212762 Aug 12 06:48:32.327830 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 44/83] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:32 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:32.695313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9794649c-1454-4286-9fe1-1ba2dec65772 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:32.695927 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9794649c-1454-4286-9fe1-1ba2dec65772 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:32.702036 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9794649c-1454-4286-9fe1-1ba2dec65772 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.702517 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9794649c-1454-4286-9fe1-1ba2dec65772 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.702992 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9794649c-1454-4286-9fe1-1ba2dec65772 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.703689 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9794649c-1454-4286-9fe1-1ba2dec65772 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.704140 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9794649c-1454-4286-9fe1-1ba2dec65772 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.704555 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9794649c-1454-4286-9fe1-1ba2dec65772 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.834613 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9794649c-1454-4286-9fe1-1ba2dec65772 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:32.843706 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9794649c-1454-4286-9fe1-1ba2dec65772 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.151986 Aug 12 06:48:32.844514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 40/84] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:32 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:32.908209 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:32.908942 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:32.916188 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.916674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.917130 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:32.918030 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:32.918484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:32.918902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:33.009195 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0554cee9-a04c-4789-a58c-66690ce53865 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:33.010476 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0554cee9-a04c-4789-a58c-66690ce53865 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:33.017200 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0554cee9-a04c-4789-a58c-66690ce53865 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:33.017817 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0554cee9-a04c-4789-a58c-66690ce53865 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:33.018462 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0554cee9-a04c-4789-a58c-66690ce53865 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:33.019335 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0554cee9-a04c-4789-a58c-66690ce53865 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:33.020733 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0554cee9-a04c-4789-a58c-66690ce53865 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:33.021300 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0554cee9-a04c-4789-a58c-66690ce53865 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:33.055390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:33.064198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:33.065711 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:33.067120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2c0231a2-2285-4878-83ab-f3cee8268115 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.162961 Aug 12 06:48:33.067862 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 45/85] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:32 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:33.154265 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0554cee9-a04c-4789-a58c-66690ce53865 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:33.161765 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0554cee9-a04c-4789-a58c-66690ce53865 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.161954 Aug 12 06:48:33.162339 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 41/86] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:32 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:33.309662 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5a25094b-8018-42e7-9553-005872ef9c54 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:33.310402 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5a25094b-8018-42e7-9553-005872ef9c54 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:33.316552 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a25094b-8018-42e7-9553-005872ef9c54 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:33.317035 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a25094b-8018-42e7-9553-005872ef9c54 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:33.317462 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a25094b-8018-42e7-9553-005872ef9c54 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:33.318148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a25094b-8018-42e7-9553-005872ef9c54 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:33.318599 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a25094b-8018-42e7-9553-005872ef9c54 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:33.319019 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a25094b-8018-42e7-9553-005872ef9c54 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:33.350969 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9330d37d-ee23-4000-bf96-70fc8f2dae83 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:33.351837 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9330d37d-ee23-4000-bf96-70fc8f2dae83 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:33.358576 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9330d37d-ee23-4000-bf96-70fc8f2dae83 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:33.359141 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9330d37d-ee23-4000-bf96-70fc8f2dae83 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:33.359566 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9330d37d-ee23-4000-bf96-70fc8f2dae83 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:33.360374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9330d37d-ee23-4000-bf96-70fc8f2dae83 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:33.360821 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9330d37d-ee23-4000-bf96-70fc8f2dae83 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:33.361234 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9330d37d-ee23-4000-bf96-70fc8f2dae83 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:33.518926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5a25094b-8018-42e7-9553-005872ef9c54 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:33.521408 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5a25094b-8018-42e7-9553-005872ef9c54 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.215529 Aug 12 06:48:33.522308 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 46/87] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:33 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:33.546341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9330d37d-ee23-4000-bf96-70fc8f2dae83 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:33.553816 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9330d37d-ee23-4000-bf96-70fc8f2dae83 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.208799 Aug 12 06:48:33.554495 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 42/88] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:33 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:33.865930 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-45a6574e-d8d6-46c5-b8fa-8a096e4697ca tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:33.866653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-45a6574e-d8d6-46c5-b8fa-8a096e4697ca tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:33.873330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45a6574e-d8d6-46c5-b8fa-8a096e4697ca tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:33.873815 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45a6574e-d8d6-46c5-b8fa-8a096e4697ca tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:33.874248 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45a6574e-d8d6-46c5-b8fa-8a096e4697ca tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:33.874923 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45a6574e-d8d6-46c5-b8fa-8a096e4697ca tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:33.875404 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45a6574e-d8d6-46c5-b8fa-8a096e4697ca tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:33.875841 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45a6574e-d8d6-46c5-b8fa-8a096e4697ca tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:34.010896 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-45a6574e-d8d6-46c5-b8fa-8a096e4697ca tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:34.017872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-45a6574e-d8d6-46c5-b8fa-8a096e4697ca tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.155764 Aug 12 06:48:34.018425 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 47/89] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:33 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:34.089836 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:34.090429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:34.096462 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:34.096934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:34.097358 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:34.098032 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:34.098464 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:34.098873 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:34.103000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:34.129059 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-adbb5add-603a-4fbc-93c3-fa77b8f4ba40 req-69307417-31f2-4e48-9803-9c3469c3fd5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6bc12e0-d758-47a7-920d-971a6e993711", "tag": "2de31bfc-bbcb-4a81-989c-adfbe72a2aac"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:34.139198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-adbb5add-603a-4fbc-93c3-fa77b8f4ba40 req-69307417-31f2-4e48-9803-9c3469c3fd5f service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:34.139783 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-adbb5add-603a-4fbc-93c3-fa77b8f4ba40 req-69307417-31f2-4e48-9803-9c3469c3fd5f service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:34.140297 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-adbb5add-603a-4fbc-93c3-fa77b8f4ba40 req-69307417-31f2-4e48-9803-9c3469c3fd5f service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:34.153579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-adbb5add-603a-4fbc-93c3-fa77b8f4ba40 req-69307417-31f2-4e48-9803-9c3469c3fd5f service nova] Creating event network-changed:2de31bfc-bbcb-4a81-989c-adfbe72a2aac for instance a6bc12e0-d758-47a7-920d-971a6e993711 on hv-cinder-84457 Aug 12 06:48:34.159030 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-adbb5add-603a-4fbc-93c3-fa77b8f4ba40 req-69307417-31f2-4e48-9803-9c3469c3fd5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034438 Aug 12 06:48:34.159653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 48/90] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:34.184186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c445fa09-1b39-41c1-894c-03e9d0a14917 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:34.185084 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c445fa09-1b39-41c1-894c-03e9d0a14917 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:34.191775 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c445fa09-1b39-41c1-894c-03e9d0a14917 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:34.192263 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c445fa09-1b39-41c1-894c-03e9d0a14917 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:34.192814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c445fa09-1b39-41c1-894c-03e9d0a14917 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:34.193673 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c445fa09-1b39-41c1-894c-03e9d0a14917 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:34.194272 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c445fa09-1b39-41c1-894c-03e9d0a14917 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:34.194787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c445fa09-1b39-41c1-894c-03e9d0a14917 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:34.252248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:34.260288 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:34.261776 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:34.263101 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-be487f1b-c973-4dc1-8482-2aee145d4b39 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.177178 Aug 12 06:48:34.264175 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 43/91] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:34 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:34.338143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c445fa09-1b39-41c1-894c-03e9d0a14917 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:34.343166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c445fa09-1b39-41c1-894c-03e9d0a14917 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.164265 Aug 12 06:48:34.343985 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 49/92] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:34 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:34.542436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6eb2062f-a420-4636-b994-d6981e4d0d42 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:34.543096 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6eb2062f-a420-4636-b994-d6981e4d0d42 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:34.549501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb2062f-a420-4636-b994-d6981e4d0d42 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:34.550002 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb2062f-a420-4636-b994-d6981e4d0d42 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:34.550622 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb2062f-a420-4636-b994-d6981e4d0d42 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:34.551485 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb2062f-a420-4636-b994-d6981e4d0d42 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:34.552195 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb2062f-a420-4636-b994-d6981e4d0d42 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:34.552687 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb2062f-a420-4636-b994-d6981e4d0d42 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:34.581046 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-39497176-667e-4ea5-895b-c98eca732995 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:34.582509 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-39497176-667e-4ea5-895b-c98eca732995 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:34.592953 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39497176-667e-4ea5-895b-c98eca732995 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:34.594203 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39497176-667e-4ea5-895b-c98eca732995 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:34.595181 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39497176-667e-4ea5-895b-c98eca732995 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:34.596235 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39497176-667e-4ea5-895b-c98eca732995 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:34.597293 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39497176-667e-4ea5-895b-c98eca732995 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:34.597723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39497176-667e-4ea5-895b-c98eca732995 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:34.641142 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:34.798877 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6eb2062f-a420-4636-b994-d6981e4d0d42 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:34.811304 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6eb2062f-a420-4636-b994-d6981e4d0d42 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.272684 Aug 12 06:48:34.811902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 44/93] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:34 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:34.852585 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-39497176-667e-4ea5-895b-c98eca732995 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:34.860009 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-39497176-667e-4ea5-895b-c98eca732995 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.289871 Aug 12 06:48:34.873911 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 50/94] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:34 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:35.038949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b80437d4-e170-47bf-99c3-31e65f2acb67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:35.039602 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b80437d4-e170-47bf-99c3-31e65f2acb67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:35.045855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b80437d4-e170-47bf-99c3-31e65f2acb67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:35.046312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b80437d4-e170-47bf-99c3-31e65f2acb67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:35.046920 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b80437d4-e170-47bf-99c3-31e65f2acb67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:35.047672 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b80437d4-e170-47bf-99c3-31e65f2acb67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:35.048120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b80437d4-e170-47bf-99c3-31e65f2acb67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:35.048567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b80437d4-e170-47bf-99c3-31e65f2acb67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:35.181958 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b80437d4-e170-47bf-99c3-31e65f2acb67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:35.190528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b80437d4-e170-47bf-99c3-31e65f2acb67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.155648 Aug 12 06:48:35.191424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 45/95] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:35 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:35.286861 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:35.287660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:35.294348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:35.294905 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:35.295428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:35.296182 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:35.296696 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:35.297115 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:35.366543 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3ef53b53-c994-47a9-9bfd-06ea195aa06c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:35.367883 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3ef53b53-c994-47a9-9bfd-06ea195aa06c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:35.375363 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef53b53-c994-47a9-9bfd-06ea195aa06c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:35.376034 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef53b53-c994-47a9-9bfd-06ea195aa06c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:35.376602 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef53b53-c994-47a9-9bfd-06ea195aa06c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:35.377505 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef53b53-c994-47a9-9bfd-06ea195aa06c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:35.378157 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef53b53-c994-47a9-9bfd-06ea195aa06c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:35.378649 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef53b53-c994-47a9-9bfd-06ea195aa06c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:35.486509 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:35.497975 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:35.500955 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:35.502670 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-83904485-9948-4fce-9c6d-b11f3cb3809b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.220818 Aug 12 06:48:35.515759 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 51/96] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:35 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:35.606150 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3ef53b53-c994-47a9-9bfd-06ea195aa06c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:35.616422 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3ef53b53-c994-47a9-9bfd-06ea195aa06c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.255581 Aug 12 06:48:35.617635 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 46/97] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:35 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:35.837313 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ba50529c-a7ab-462e-b1d1-253c57a5481c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:35.837912 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ba50529c-a7ab-462e-b1d1-253c57a5481c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:35.852009 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ba50529c-a7ab-462e-b1d1-253c57a5481c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:35.852845 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ba50529c-a7ab-462e-b1d1-253c57a5481c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:35.853526 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ba50529c-a7ab-462e-b1d1-253c57a5481c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:35.854368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ba50529c-a7ab-462e-b1d1-253c57a5481c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:35.855831 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ba50529c-a7ab-462e-b1d1-253c57a5481c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:35.856469 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ba50529c-a7ab-462e-b1d1-253c57a5481c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:35.881499 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ccdc3d89-8c23-41db-a53c-d02cc42f4396 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:35.882465 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ccdc3d89-8c23-41db-a53c-d02cc42f4396 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:35.893890 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccdc3d89-8c23-41db-a53c-d02cc42f4396 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:35.894501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccdc3d89-8c23-41db-a53c-d02cc42f4396 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:35.894791 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccdc3d89-8c23-41db-a53c-d02cc42f4396 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:35.895510 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccdc3d89-8c23-41db-a53c-d02cc42f4396 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:35.895951 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccdc3d89-8c23-41db-a53c-d02cc42f4396 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:35.896362 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccdc3d89-8c23-41db-a53c-d02cc42f4396 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:36.286342 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ba50529c-a7ab-462e-b1d1-253c57a5481c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:36.294275 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ccdc3d89-8c23-41db-a53c-d02cc42f4396 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:36.305472 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ccdc3d89-8c23-41db-a53c-d02cc42f4396 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.428029 Aug 12 06:48:36.320585 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ba50529c-a7ab-462e-b1d1-253c57a5481c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.487008 Aug 12 06:48:36.321270 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 47/98] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:35 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:36.323672 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 52/99] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:35 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:36.327861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7938a8c0-d620-4ecc-b770-e36022223b66 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:36.328599 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7938a8c0-d620-4ecc-b770-e36022223b66 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:36.337586 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7938a8c0-d620-4ecc-b770-e36022223b66 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:36.338432 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7938a8c0-d620-4ecc-b770-e36022223b66 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:36.338925 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7938a8c0-d620-4ecc-b770-e36022223b66 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:36.339735 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7938a8c0-d620-4ecc-b770-e36022223b66 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:36.340249 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7938a8c0-d620-4ecc-b770-e36022223b66 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:36.340733 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7938a8c0-d620-4ecc-b770-e36022223b66 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:36.489506 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7938a8c0-d620-4ecc-b770-e36022223b66 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:36.497432 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7938a8c0-d620-4ecc-b770-e36022223b66 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.174673 Aug 12 06:48:36.498190 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 48/100] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:36 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:36.532353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:36.533672 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:36.544790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:36.545744 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:36.546502 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:36.547737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:36.548378 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:36.548975 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:36.637328 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6df0a06e-9082-47ee-b556-e1f5a5d3370a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:36.638855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6df0a06e-9082-47ee-b556-e1f5a5d3370a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:36.645699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6df0a06e-9082-47ee-b556-e1f5a5d3370a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:36.646937 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6df0a06e-9082-47ee-b556-e1f5a5d3370a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:36.647907 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6df0a06e-9082-47ee-b556-e1f5a5d3370a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:36.648917 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6df0a06e-9082-47ee-b556-e1f5a5d3370a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:36.649636 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6df0a06e-9082-47ee-b556-e1f5a5d3370a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:36.650315 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6df0a06e-9082-47ee-b556-e1f5a5d3370a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:36.754668 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:36.769779 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:36.773431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:36.774609 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5e7d2a92-3a09-4152-bea3-7c1f68b0e04a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.248904 Aug 12 06:48:36.779268 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 53/101] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:36 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:36.856718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6df0a06e-9082-47ee-b556-e1f5a5d3370a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:36.866356 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6df0a06e-9082-47ee-b556-e1f5a5d3370a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.232329 Aug 12 06:48:36.880098 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 49/102] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:36 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:36.981783 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-27c33f2d-4757-4bc1-884f-82aa7387715b req-5a2fc897-6bed-4c79-aabd-228eac421e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a023b3c-3e26-4379-b327-e5d86cbf2cae", "name": "network-vif-plugged", "status": "completed", "tag": "6068429d-1e1c-4e95-a5ef-a47d18e418da"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:36.992031 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-27c33f2d-4757-4bc1-884f-82aa7387715b req-5a2fc897-6bed-4c79-aabd-228eac421e8a service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:36.992600 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-27c33f2d-4757-4bc1-884f-82aa7387715b req-5a2fc897-6bed-4c79-aabd-228eac421e8a service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:36.992894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-27c33f2d-4757-4bc1-884f-82aa7387715b req-5a2fc897-6bed-4c79-aabd-228eac421e8a service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:37.006352 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-27c33f2d-4757-4bc1-884f-82aa7387715b req-5a2fc897-6bed-4c79-aabd-228eac421e8a service nova] Creating event network-vif-plugged:6068429d-1e1c-4e95-a5ef-a47d18e418da for instance 6a023b3c-3e26-4379-b327-e5d86cbf2cae on hv-cinder-84457 Aug 12 06:48:37.012571 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-27c33f2d-4757-4bc1-884f-82aa7387715b req-5a2fc897-6bed-4c79-aabd-228eac421e8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034856 Aug 12 06:48:37.013220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 54/103] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:48:37.328501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3b8d944a-193b-4fc3-8d09-2eb606cb8bf8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:37.329071 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3b8d944a-193b-4fc3-8d09-2eb606cb8bf8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:37.335991 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b8d944a-193b-4fc3-8d09-2eb606cb8bf8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:37.336687 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b8d944a-193b-4fc3-8d09-2eb606cb8bf8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:37.337450 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b8d944a-193b-4fc3-8d09-2eb606cb8bf8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:37.338288 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b8d944a-193b-4fc3-8d09-2eb606cb8bf8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:37.340494 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b8d944a-193b-4fc3-8d09-2eb606cb8bf8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:37.341109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b8d944a-193b-4fc3-8d09-2eb606cb8bf8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:37.345401 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-782c08be-4be9-4796-a816-f2efd9067a5a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:37.346174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-782c08be-4be9-4796-a816-f2efd9067a5a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:37.355676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-782c08be-4be9-4796-a816-f2efd9067a5a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:37.356165 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-782c08be-4be9-4796-a816-f2efd9067a5a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:37.356594 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-782c08be-4be9-4796-a816-f2efd9067a5a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:37.357290 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-782c08be-4be9-4796-a816-f2efd9067a5a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:37.357733 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-782c08be-4be9-4796-a816-f2efd9067a5a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:37.358111 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-782c08be-4be9-4796-a816-f2efd9067a5a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:37.646904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3b8d944a-193b-4fc3-8d09-2eb606cb8bf8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:37.655272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3b8d944a-193b-4fc3-8d09-2eb606cb8bf8 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.333399 Aug 12 06:48:37.655950 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 50/104] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:37 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:37.661004 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-31020425-b7b2-4e23-8c09-0e8744de6c31 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:37.661216 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-782c08be-4be9-4796-a816-f2efd9067a5a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:37.661703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-31020425-b7b2-4e23-8c09-0e8744de6c31 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:37.668598 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31020425-b7b2-4e23-8c09-0e8744de6c31 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:37.669497 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31020425-b7b2-4e23-8c09-0e8744de6c31 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:37.670192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31020425-b7b2-4e23-8c09-0e8744de6c31 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:37.671206 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31020425-b7b2-4e23-8c09-0e8744de6c31 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:37.671754 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31020425-b7b2-4e23-8c09-0e8744de6c31 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:37.672407 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31020425-b7b2-4e23-8c09-0e8744de6c31 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:37.675259 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-782c08be-4be9-4796-a816-f2efd9067a5a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.334504 Aug 12 06:48:37.675823 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 55/105] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:37 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:37.799894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:37.800609 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:37.817601 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:37.818472 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:37.819009 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:37.819818 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:37.820482 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:37.820976 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:37.850217 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-31020425-b7b2-4e23-8c09-0e8744de6c31 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:37.862663 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-31020425-b7b2-4e23-8c09-0e8744de6c31 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.205121 Aug 12 06:48:37.863725 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 51/106] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:37 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:37.888833 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8e406838-0543-4914-8018-8bb1cc9a39b4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:37.889740 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8e406838-0543-4914-8018-8bb1cc9a39b4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:37.898212 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e406838-0543-4914-8018-8bb1cc9a39b4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:37.898937 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e406838-0543-4914-8018-8bb1cc9a39b4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:37.899922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e406838-0543-4914-8018-8bb1cc9a39b4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:37.901024 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e406838-0543-4914-8018-8bb1cc9a39b4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:37.901823 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e406838-0543-4914-8018-8bb1cc9a39b4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:37.902821 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e406838-0543-4914-8018-8bb1cc9a39b4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:38.152003 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:38.162337 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:38.163944 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:38.165337 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3029334b-7389-4fd3-9d16-3e3b73c2c217 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.369457 Aug 12 06:48:38.179888 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 56/107] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:37 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:38.198079 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8e406838-0543-4914-8018-8bb1cc9a39b4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:38.207173 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8e406838-0543-4914-8018-8bb1cc9a39b4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.322083 Aug 12 06:48:38.207845 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 52/108] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:37 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:38.680467 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-32e838dd-01d7-4fb4-97d2-7da217684bbf tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:38.681169 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-32e838dd-01d7-4fb4-97d2-7da217684bbf tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:38.687356 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32e838dd-01d7-4fb4-97d2-7da217684bbf tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:38.687821 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32e838dd-01d7-4fb4-97d2-7da217684bbf tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:38.688520 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32e838dd-01d7-4fb4-97d2-7da217684bbf tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:38.689218 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32e838dd-01d7-4fb4-97d2-7da217684bbf tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:38.689817 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32e838dd-01d7-4fb4-97d2-7da217684bbf tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:38.690379 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32e838dd-01d7-4fb4-97d2-7da217684bbf tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:38.701929 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-af243e23-8e6b-4773-a852-ab572f1665ff tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:38.703577 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-af243e23-8e6b-4773-a852-ab572f1665ff tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:38.713699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af243e23-8e6b-4773-a852-ab572f1665ff tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:38.714335 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af243e23-8e6b-4773-a852-ab572f1665ff tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:38.715415 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af243e23-8e6b-4773-a852-ab572f1665ff tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:38.716584 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af243e23-8e6b-4773-a852-ab572f1665ff tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:38.717140 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af243e23-8e6b-4773-a852-ab572f1665ff tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:38.717691 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af243e23-8e6b-4773-a852-ab572f1665ff tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:38.957831 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-32e838dd-01d7-4fb4-97d2-7da217684bbf tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:38.968129 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-32e838dd-01d7-4fb4-97d2-7da217684bbf tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.291719 Aug 12 06:48:38.968672 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af243e23-8e6b-4773-a852-ab572f1665ff tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:38.968817 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 57/109] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:38 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:38.974969 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-03016474-af69-4e30-abd1-a9a970b90c28 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:38.976019 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-03016474-af69-4e30-abd1-a9a970b90c28 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:38.980618 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-af243e23-8e6b-4773-a852-ab572f1665ff tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.286946 Aug 12 06:48:38.982718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 53/110] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:38 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:38.996828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03016474-af69-4e30-abd1-a9a970b90c28 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:38.997409 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03016474-af69-4e30-abd1-a9a970b90c28 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:38.997929 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03016474-af69-4e30-abd1-a9a970b90c28 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:38.998732 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03016474-af69-4e30-abd1-a9a970b90c28 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:38.999242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03016474-af69-4e30-abd1-a9a970b90c28 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:38.999652 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03016474-af69-4e30-abd1-a9a970b90c28 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:39.039162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-46bd5de8-a6fc-4e27-97cc-370027898cfc req-faec4f6f-9aa8-4627-b993-6cd995386972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5e7e6c-f576-47c1-8fb5-407e318d15c4", "name": "network-vif-plugged", "status": "completed", "tag": "27e18af9-c038-4192-b7a5-a893995402b0"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:39.050872 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-46bd5de8-a6fc-4e27-97cc-370027898cfc req-faec4f6f-9aa8-4627-b993-6cd995386972 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:39.051356 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-46bd5de8-a6fc-4e27-97cc-370027898cfc req-faec4f6f-9aa8-4627-b993-6cd995386972 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:39.054589 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-46bd5de8-a6fc-4e27-97cc-370027898cfc req-faec4f6f-9aa8-4627-b993-6cd995386972 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:39.076529 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-46bd5de8-a6fc-4e27-97cc-370027898cfc req-faec4f6f-9aa8-4627-b993-6cd995386972 service nova] Creating event network-vif-plugged:27e18af9-c038-4192-b7a5-a893995402b0 for instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 on hv-cinder-84457 Aug 12 06:48:39.085031 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-46bd5de8-a6fc-4e27-97cc-370027898cfc req-faec4f6f-9aa8-4627-b993-6cd995386972 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049747 Aug 12 06:48:39.085963 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 54/111] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:39.191655 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:39.192737 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:39.200950 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:39.205480 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:39.206104 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:39.207611 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:39.208217 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:39.208942 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:39.360132 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-03016474-af69-4e30-abd1-a9a970b90c28 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:39.371938 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-03016474-af69-4e30-abd1-a9a970b90c28 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.402150 Aug 12 06:48:39.375355 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 58/112] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:38 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:39.390768 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ab0e0c74-cd2c-4237-a3b8-242e86ceeba7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:39.391584 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ab0e0c74-cd2c-4237-a3b8-242e86ceeba7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:39.400079 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab0e0c74-cd2c-4237-a3b8-242e86ceeba7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:39.400769 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab0e0c74-cd2c-4237-a3b8-242e86ceeba7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:39.401349 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab0e0c74-cd2c-4237-a3b8-242e86ceeba7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:39.402251 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab0e0c74-cd2c-4237-a3b8-242e86ceeba7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:39.402850 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab0e0c74-cd2c-4237-a3b8-242e86ceeba7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:39.403441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab0e0c74-cd2c-4237-a3b8-242e86ceeba7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:39.461754 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:39.470085 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:39.471751 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:39.473225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-81d178dc-3ba2-4183-b87b-f8da821b6701 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.288428 Aug 12 06:48:39.473862 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 55/113] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:39 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:48:39.556228 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ab0e0c74-cd2c-4237-a3b8-242e86ceeba7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:39.564148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ab0e0c74-cd2c-4237-a3b8-242e86ceeba7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.187499 Aug 12 06:48:39.564755 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 59/114] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:39 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:39.990111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-62b1f250-0511-40a4-b21f-6020ff31910f tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:39.990823 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-62b1f250-0511-40a4-b21f-6020ff31910f tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:39.998665 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62b1f250-0511-40a4-b21f-6020ff31910f tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:39.999505 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62b1f250-0511-40a4-b21f-6020ff31910f tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:39.999978 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62b1f250-0511-40a4-b21f-6020ff31910f tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:40.000861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62b1f250-0511-40a4-b21f-6020ff31910f tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:40.001300 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62b1f250-0511-40a4-b21f-6020ff31910f tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:40.001898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62b1f250-0511-40a4-b21f-6020ff31910f tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:40.004390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e95eafc1-40ac-4024-aa6e-b4e6e5eef461 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:40.005022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e95eafc1-40ac-4024-aa6e-b4e6e5eef461 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:40.013125 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e95eafc1-40ac-4024-aa6e-b4e6e5eef461 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:40.013950 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e95eafc1-40ac-4024-aa6e-b4e6e5eef461 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:40.014518 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e95eafc1-40ac-4024-aa6e-b4e6e5eef461 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:40.015515 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e95eafc1-40ac-4024-aa6e-b4e6e5eef461 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:40.016103 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e95eafc1-40ac-4024-aa6e-b4e6e5eef461 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:40.016854 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e95eafc1-40ac-4024-aa6e-b4e6e5eef461 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:40.637172 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-62b1f250-0511-40a4-b21f-6020ff31910f tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:40.644974 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-62b1f250-0511-40a4-b21f-6020ff31910f tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.659459 Aug 12 06:48:40.645370 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 56/115] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:39 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:40.657876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c763ec5d-d2c3-45c7-889d-a6807c058522 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:40.662329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c763ec5d-d2c3-45c7-889d-a6807c058522 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:40.668686 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:40.679198 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c763ec5d-d2c3-45c7-889d-a6807c058522 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:40.679763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c763ec5d-d2c3-45c7-889d-a6807c058522 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:40.682187 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c763ec5d-d2c3-45c7-889d-a6807c058522 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:40.683017 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c763ec5d-d2c3-45c7-889d-a6807c058522 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:40.683660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c763ec5d-d2c3-45c7-889d-a6807c058522 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:40.684257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c763ec5d-d2c3-45c7-889d-a6807c058522 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:40.701918 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e95eafc1-40ac-4024-aa6e-b4e6e5eef461 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:40.715436 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e95eafc1-40ac-4024-aa6e-b4e6e5eef461 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.713729 Aug 12 06:48:40.716551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 60/116] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:39 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:40.735318 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:40.737650 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:40.752909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:40.755905 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:40.756940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:40.759013 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:40.760101 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:40.761278 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:41.042130 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c763ec5d-d2c3-45c7-889d-a6807c058522 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:41.053861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c763ec5d-d2c3-45c7-889d-a6807c058522 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.407410 Aug 12 06:48:41.056552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 57/117] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:40 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:41.062367 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ab2e3c91-915c-4cdd-b441-1d673a1ff998 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:41.063221 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ab2e3c91-915c-4cdd-b441-1d673a1ff998 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:41.068395 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:41.070765 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab2e3c91-915c-4cdd-b441-1d673a1ff998 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:41.071570 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab2e3c91-915c-4cdd-b441-1d673a1ff998 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:41.072182 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab2e3c91-915c-4cdd-b441-1d673a1ff998 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:41.073068 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab2e3c91-915c-4cdd-b441-1d673a1ff998 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:41.073914 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab2e3c91-915c-4cdd-b441-1d673a1ff998 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:41.074513 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab2e3c91-915c-4cdd-b441-1d673a1ff998 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:41.095822 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:41.103428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:41.104794 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f3e14567-5117-4500-a8f4-2d1b0b276954 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.384733 Aug 12 06:48:41.113393 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 61/118] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:40 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:41.125484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-daf6e4bb-24d2-449c-b964-02f350dc36fa req-5b620747-88d1-4df0-99a9-ad14936657e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67edb8b-4485-4696-9f6a-bb7138745e8a", "name": "network-vif-plugged", "status": "completed", "tag": "13351888-408a-44b4-b929-ce7da277b2ea"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:41.137803 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-daf6e4bb-24d2-449c-b964-02f350dc36fa req-5b620747-88d1-4df0-99a9-ad14936657e2 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:41.138217 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-daf6e4bb-24d2-449c-b964-02f350dc36fa req-5b620747-88d1-4df0-99a9-ad14936657e2 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:41.139561 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-daf6e4bb-24d2-449c-b964-02f350dc36fa req-5b620747-88d1-4df0-99a9-ad14936657e2 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:41.154421 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-daf6e4bb-24d2-449c-b964-02f350dc36fa req-5b620747-88d1-4df0-99a9-ad14936657e2 service nova] Creating event network-vif-plugged:13351888-408a-44b4-b929-ce7da277b2ea for instance d67edb8b-4485-4696-9f6a-bb7138745e8a on hv-cinder-84457 Aug 12 06:48:41.159450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-daf6e4bb-24d2-449c-b964-02f350dc36fa req-5b620747-88d1-4df0-99a9-ad14936657e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044162 Aug 12 06:48:41.166442 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 62/119] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:41.278490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ab2e3c91-915c-4cdd-b441-1d673a1ff998 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:41.287760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ab2e3c91-915c-4cdd-b441-1d673a1ff998 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.228502 Aug 12 06:48:41.294355 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 58/120] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:41 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:41.671952 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9bbce15d-af1d-4623-b0d0-0a50c59505d2 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:41.673452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9bbce15d-af1d-4623-b0d0-0a50c59505d2 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:41.691704 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9bbce15d-af1d-4623-b0d0-0a50c59505d2 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:41.693854 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9bbce15d-af1d-4623-b0d0-0a50c59505d2 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:41.696223 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9bbce15d-af1d-4623-b0d0-0a50c59505d2 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:41.700150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9bbce15d-af1d-4623-b0d0-0a50c59505d2 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:41.700786 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9bbce15d-af1d-4623-b0d0-0a50c59505d2 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:41.705359 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9bbce15d-af1d-4623-b0d0-0a50c59505d2 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:41.745768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d5162484-3c2f-4933-a416-cae447e633d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:41.746593 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d5162484-3c2f-4933-a416-cae447e633d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:41.759467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5162484-3c2f-4933-a416-cae447e633d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:41.759977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5162484-3c2f-4933-a416-cae447e633d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:41.760812 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5162484-3c2f-4933-a416-cae447e633d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:41.766695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5162484-3c2f-4933-a416-cae447e633d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:41.766695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5162484-3c2f-4933-a416-cae447e633d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:41.766695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5162484-3c2f-4933-a416-cae447e633d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:42.039612 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:42.131425 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9bbce15d-af1d-4623-b0d0-0a50c59505d2 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:42.145769 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d5162484-3c2f-4933-a416-cae447e633d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:42.148145 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9bbce15d-af1d-4623-b0d0-0a50c59505d2 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.485151 Aug 12 06:48:42.148725 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 63/121] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:41 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:42.154486 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a45b59b4-4444-4987-81fa-74ac60036610 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:42.155113 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a45b59b4-4444-4987-81fa-74ac60036610 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:42.156314 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d5162484-3c2f-4933-a416-cae447e633d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1322 microversion: 2.1 time: 0.416352 Aug 12 06:48:42.171448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 59/122] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:41 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:42.174410 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a45b59b4-4444-4987-81fa-74ac60036610 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:42.174969 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a45b59b4-4444-4987-81fa-74ac60036610 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:42.175577 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a45b59b4-4444-4987-81fa-74ac60036610 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:42.176335 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a45b59b4-4444-4987-81fa-74ac60036610 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:42.176846 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a45b59b4-4444-4987-81fa-74ac60036610 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:42.177324 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a45b59b4-4444-4987-81fa-74ac60036610 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:42.179631 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:42.181050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:42.188943 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:42.189712 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:42.190234 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:42.191171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:42.191833 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:42.192516 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:42.213142 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:42.452483 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:42.456296 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a45b59b4-4444-4987-81fa-74ac60036610 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:42.464141 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:42.464456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a45b59b4-4444-4987-81fa-74ac60036610 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.314098 Aug 12 06:48:42.465668 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:42.466772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7a866ba3-7ca7-436f-8c9f-311dded3f718 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.294025 Aug 12 06:48:42.479278 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 64/123] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:42 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:42.485794 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-36d3b398-f187-4e97-a3ff-a775ced6ba67 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:42.486785 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-36d3b398-f187-4e97-a3ff-a775ced6ba67 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:42.487210 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 60/124] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:42 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:42.494330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36d3b398-f187-4e97-a3ff-a775ced6ba67 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:42.495531 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36d3b398-f187-4e97-a3ff-a775ced6ba67 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:42.496418 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36d3b398-f187-4e97-a3ff-a775ced6ba67 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:42.497466 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36d3b398-f187-4e97-a3ff-a775ced6ba67 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:42.498199 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36d3b398-f187-4e97-a3ff-a775ced6ba67 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:42.498954 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36d3b398-f187-4e97-a3ff-a775ced6ba67 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:42.720480 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-36d3b398-f187-4e97-a3ff-a775ced6ba67 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:42.733543 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-36d3b398-f187-4e97-a3ff-a775ced6ba67 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.250394 Aug 12 06:48:42.734811 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 65/125] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:42 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:43.182852 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f1e1f2fd-f190-46b3-abd0-0b50f1efe279 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:43.185364 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f1e1f2fd-f190-46b3-abd0-0b50f1efe279 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:43.185844 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-88811b0b-fed8-49f5-98c5-42d8b0ec5bd0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:43.189681 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-88811b0b-fed8-49f5-98c5-42d8b0ec5bd0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:43.205061 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88811b0b-fed8-49f5-98c5-42d8b0ec5bd0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.205558 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88811b0b-fed8-49f5-98c5-42d8b0ec5bd0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.205993 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88811b0b-fed8-49f5-98c5-42d8b0ec5bd0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.206950 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1e1f2fd-f190-46b3-abd0-0b50f1efe279 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.207595 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1e1f2fd-f190-46b3-abd0-0b50f1efe279 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.207975 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1e1f2fd-f190-46b3-abd0-0b50f1efe279 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.208898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1e1f2fd-f190-46b3-abd0-0b50f1efe279 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.209902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1e1f2fd-f190-46b3-abd0-0b50f1efe279 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.210331 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1e1f2fd-f190-46b3-abd0-0b50f1efe279 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.213573 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88811b0b-fed8-49f5-98c5-42d8b0ec5bd0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.214398 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88811b0b-fed8-49f5-98c5-42d8b0ec5bd0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.215174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88811b0b-fed8-49f5-98c5-42d8b0ec5bd0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.603251 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f1e1f2fd-f190-46b3-abd0-0b50f1efe279 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:43.611319 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f1e1f2fd-f190-46b3-abd0-0b50f1efe279 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.444026 Aug 12 06:48:43.612544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 61/126] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:43 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:43.620067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-e2661683-5a34-41cd-be79-94de18d967ff req-b2026d91-b780-40fb-82ca-9ac18566a167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bc12e0-d758-47a7-920d-971a6e993711", "name": "network-vif-plugged", "status": "completed", "tag": "2de31bfc-bbcb-4a81-989c-adfbe72a2aac"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:43.627968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-88811b0b-fed8-49f5-98c5-42d8b0ec5bd0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:43.632935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e2661683-5a34-41cd-be79-94de18d967ff req-b2026d91-b780-40fb-82ca-9ac18566a167 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.633208 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e2661683-5a34-41cd-be79-94de18d967ff req-b2026d91-b780-40fb-82ca-9ac18566a167 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.634140 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e2661683-5a34-41cd-be79-94de18d967ff req-b2026d91-b780-40fb-82ca-9ac18566a167 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.638038 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-88811b0b-fed8-49f5-98c5-42d8b0ec5bd0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1515 microversion: 2.1 time: 0.463052 Aug 12 06:48:43.638649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 66/127] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:43 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1515 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:43.649466 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-e2661683-5a34-41cd-be79-94de18d967ff req-b2026d91-b780-40fb-82ca-9ac18566a167 service nova] Creating event network-vif-plugged:2de31bfc-bbcb-4a81-989c-adfbe72a2aac for instance a6bc12e0-d758-47a7-920d-971a6e993711 on hv-cinder-84457 Aug 12 06:48:43.650456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-17fc6c98-732a-4006-8d67-5372a8db5a76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:43.651389 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-17fc6c98-732a-4006-8d67-5372a8db5a76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:43.657220 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-e2661683-5a34-41cd-be79-94de18d967ff req-b2026d91-b780-40fb-82ca-9ac18566a167 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042981 Aug 12 06:48:43.658570 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 62/128] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:43.659015 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17fc6c98-732a-4006-8d67-5372a8db5a76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.659819 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17fc6c98-732a-4006-8d67-5372a8db5a76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.660556 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17fc6c98-732a-4006-8d67-5372a8db5a76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.662558 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17fc6c98-732a-4006-8d67-5372a8db5a76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.663101 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17fc6c98-732a-4006-8d67-5372a8db5a76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.663519 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17fc6c98-732a-4006-8d67-5372a8db5a76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.669555 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:43.670272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:43.683396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.683874 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.684295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.685039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.685490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.685899 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.934959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-17fc6c98-732a-4006-8d67-5372a8db5a76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:43.946948 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:43.949283 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-17fc6c98-732a-4006-8d67-5372a8db5a76 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.306612 Aug 12 06:48:43.949924 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 67/129] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:43 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:43.961311 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:43.962138 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-63a44879-accb-4717-b775-8f39dd302da9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:43.968120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:43.969566 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-63a44879-accb-4717-b775-8f39dd302da9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:43.973989 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5c5776ad-cd0b-4ead-961b-51edc975f83e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.311600 Aug 12 06:48:43.975229 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 63/130] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:43 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:43.987167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-001158be-1ec4-4ed7-97d5-4e7ab6eca34e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:43.987167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-001158be-1ec4-4ed7-97d5-4e7ab6eca34e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:43.987365 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63a44879-accb-4717-b775-8f39dd302da9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.987365 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63a44879-accb-4717-b775-8f39dd302da9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.987365 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63a44879-accb-4717-b775-8f39dd302da9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.988722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63a44879-accb-4717-b775-8f39dd302da9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.990196 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63a44879-accb-4717-b775-8f39dd302da9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.990642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63a44879-accb-4717-b775-8f39dd302da9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.996899 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-001158be-1ec4-4ed7-97d5-4e7ab6eca34e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.997382 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-001158be-1ec4-4ed7-97d5-4e7ab6eca34e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.997799 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-001158be-1ec4-4ed7-97d5-4e7ab6eca34e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:43.998484 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-001158be-1ec4-4ed7-97d5-4e7ab6eca34e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:43.998920 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-001158be-1ec4-4ed7-97d5-4e7ab6eca34e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:43.999919 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-001158be-1ec4-4ed7-97d5-4e7ab6eca34e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:44.029900 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:44.090022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-63a44879-accb-4717-b775-8f39dd302da9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lazy-loading 'flavor' on Instance uuid 6a023b3c-3e26-4379-b327-e5d86cbf2cae {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:48:44.216693 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-001158be-1ec4-4ed7-97d5-4e7ab6eca34e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:44.228983 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-001158be-1ec4-4ed7-97d5-4e7ab6eca34e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1366 microversion: 2.1 time: 0.252263 Aug 12 06:48:44.229887 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 64/131] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:43 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:44.263726 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-63a44879-accb-4717-b775-8f39dd302da9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "POST /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae/action" status: 200 len: 32 microversion: 2.1 time: 0.312565 Aug 12 06:48:44.264738 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 68/132] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:48:43 2022] POST /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae/action => generated 32 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 06:48:44.275254 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-69df0c30-4e4e-454d-a2bf-05730fb2e1ef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:44.279223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-69df0c30-4e4e-454d-a2bf-05730fb2e1ef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:44.287006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69df0c30-4e4e-454d-a2bf-05730fb2e1ef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:44.287469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69df0c30-4e4e-454d-a2bf-05730fb2e1ef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:44.288002 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69df0c30-4e4e-454d-a2bf-05730fb2e1ef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:44.288841 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69df0c30-4e4e-454d-a2bf-05730fb2e1ef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:44.289212 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69df0c30-4e4e-454d-a2bf-05730fb2e1ef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:44.289692 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69df0c30-4e4e-454d-a2bf-05730fb2e1ef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:44.456168 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-69df0c30-4e4e-454d-a2bf-05730fb2e1ef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:44.468268 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-69df0c30-4e4e-454d-a2bf-05730fb2e1ef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.197540 Aug 12 06:48:44.469269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 65/133] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:44 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:44.649509 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f22a4688-e8e8-42df-bf33-f5236e3c9a9c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:44.650534 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f22a4688-e8e8-42df-bf33-f5236e3c9a9c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:44.658612 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f22a4688-e8e8-42df-bf33-f5236e3c9a9c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:44.659268 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f22a4688-e8e8-42df-bf33-f5236e3c9a9c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:44.659987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f22a4688-e8e8-42df-bf33-f5236e3c9a9c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:44.661423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f22a4688-e8e8-42df-bf33-f5236e3c9a9c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:44.662172 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f22a4688-e8e8-42df-bf33-f5236e3c9a9c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:44.663013 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f22a4688-e8e8-42df-bf33-f5236e3c9a9c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:44.858390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f22a4688-e8e8-42df-bf33-f5236e3c9a9c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:44.878291 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f22a4688-e8e8-42df-bf33-f5236e3c9a9c tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1314 microversion: 2.1 time: 0.246768 Aug 12 06:48:44.880517 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 69/134] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:44 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:44.971393 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9d36c41d-3d14-4de5-968c-213d547b6edf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:44.971933 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9d36c41d-3d14-4de5-968c-213d547b6edf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:44.977997 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d36c41d-3d14-4de5-968c-213d547b6edf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:44.978731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d36c41d-3d14-4de5-968c-213d547b6edf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:44.979194 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d36c41d-3d14-4de5-968c-213d547b6edf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:44.980107 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d36c41d-3d14-4de5-968c-213d547b6edf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:44.980517 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d36c41d-3d14-4de5-968c-213d547b6edf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:44.981192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d36c41d-3d14-4de5-968c-213d547b6edf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:44.999021 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:45.000426 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:45.013252 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:45.013768 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:45.014197 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:45.017059 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:45.017566 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:45.022435 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:45.312629 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9d36c41d-3d14-4de5-968c-213d547b6edf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:45.322098 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9d36c41d-3d14-4de5-968c-213d547b6edf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.355459 Aug 12 06:48:45.338902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 66/135] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:44 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:45.341280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:45.345880 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-618a5e0d-c3c0-4921-8d1c-5aa034dfbc45 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:45.347030 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-618a5e0d-c3c0-4921-8d1c-5aa034dfbc45 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:45.352834 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:45.353821 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618a5e0d-c3c0-4921-8d1c-5aa034dfbc45 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:45.354298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618a5e0d-c3c0-4921-8d1c-5aa034dfbc45 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:45.354745 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618a5e0d-c3c0-4921-8d1c-5aa034dfbc45 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:45.355563 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:45.355710 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618a5e0d-c3c0-4921-8d1c-5aa034dfbc45 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:45.356129 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618a5e0d-c3c0-4921-8d1c-5aa034dfbc45 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:45.356589 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618a5e0d-c3c0-4921-8d1c-5aa034dfbc45 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:45.357707 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b55de519-1c8f-4829-8ccf-52b34cde8f78 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.362798 Aug 12 06:48:45.367840 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 70/136] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:44 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:48:45.489640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a3711bc3-b155-4773-8672-53cba948ec38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:45.490467 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a3711bc3-b155-4773-8672-53cba948ec38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:45.497167 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3711bc3-b155-4773-8672-53cba948ec38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:45.497805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3711bc3-b155-4773-8672-53cba948ec38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:45.498514 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3711bc3-b155-4773-8672-53cba948ec38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:45.499416 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3711bc3-b155-4773-8672-53cba948ec38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:45.500291 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3711bc3-b155-4773-8672-53cba948ec38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:45.500901 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3711bc3-b155-4773-8672-53cba948ec38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:45.531591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-618a5e0d-c3c0-4921-8d1c-5aa034dfbc45 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:45.541236 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-618a5e0d-c3c0-4921-8d1c-5aa034dfbc45 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1556 microversion: 2.1 time: 0.200906 Aug 12 06:48:45.542203 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 67/137] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:45 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1556 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:45.569136 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5d88d679-77bf-4dbe-aecb-721415e3197b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:45.569890 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5d88d679-77bf-4dbe-aecb-721415e3197b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:45.577743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d88d679-77bf-4dbe-aecb-721415e3197b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:45.578585 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d88d679-77bf-4dbe-aecb-721415e3197b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:45.579247 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d88d679-77bf-4dbe-aecb-721415e3197b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:45.580151 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d88d679-77bf-4dbe-aecb-721415e3197b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:45.580990 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d88d679-77bf-4dbe-aecb-721415e3197b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:45.581600 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d88d679-77bf-4dbe-aecb-721415e3197b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:45.676001 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a3711bc3-b155-4773-8672-53cba948ec38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:45.685728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a3711bc3-b155-4773-8672-53cba948ec38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.199983 Aug 12 06:48:45.687428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 71/138] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:45 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:45.704129 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-8b575114-1cfc-43d6-ae37-51b34649f58a req-69433926-3558-463b-9f2b-34a796cf64f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6cd9b2-0e48-4ace-96c2-ba691c366ae1", "name": "network-vif-plugged", "status": "completed", "tag": "3e7b26bb-9495-4cbe-a8c3-ab4dc50cc862"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:45.735428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-8b575114-1cfc-43d6-ae37-51b34649f58a req-69433926-3558-463b-9f2b-34a796cf64f5 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:45.736234 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-8b575114-1cfc-43d6-ae37-51b34649f58a req-69433926-3558-463b-9f2b-34a796cf64f5 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:45.736803 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-8b575114-1cfc-43d6-ae37-51b34649f58a req-69433926-3558-463b-9f2b-34a796cf64f5 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:45.767411 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-8b575114-1cfc-43d6-ae37-51b34649f58a req-69433926-3558-463b-9f2b-34a796cf64f5 service nova] Creating event network-vif-plugged:3e7b26bb-9495-4cbe-a8c3-ab4dc50cc862 for instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 on hv-cinder-84457 Aug 12 06:48:45.773688 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-8b575114-1cfc-43d6-ae37-51b34649f58a req-69433926-3558-463b-9f2b-34a796cf64f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084342 Aug 12 06:48:45.774877 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 72/139] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:45.783729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5d88d679-77bf-4dbe-aecb-721415e3197b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.219967 Aug 12 06:48:45.784422 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 68/140] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 06:48:45 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:45.914939 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-554cf376-3816-40e2-b1e4-2d1b7a1a8ff3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:45.916057 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-554cf376-3816-40e2-b1e4-2d1b7a1a8ff3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:45.923838 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-554cf376-3816-40e2-b1e4-2d1b7a1a8ff3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:45.924710 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-554cf376-3816-40e2-b1e4-2d1b7a1a8ff3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:45.925295 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-554cf376-3816-40e2-b1e4-2d1b7a1a8ff3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:45.926214 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-554cf376-3816-40e2-b1e4-2d1b7a1a8ff3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:45.926829 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-554cf376-3816-40e2-b1e4-2d1b7a1a8ff3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:45.927450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-554cf376-3816-40e2-b1e4-2d1b7a1a8ff3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:46.103778 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-554cf376-3816-40e2-b1e4-2d1b7a1a8ff3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:46.112593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-554cf376-3816-40e2-b1e4-2d1b7a1a8ff3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1501 microversion: 2.1 time: 0.203257 Aug 12 06:48:46.116383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 73/141] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:45 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:46.361133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-695b88ba-39ea-4188-bc1e-65ed9ec83981 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:46.361977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-695b88ba-39ea-4188-bc1e-65ed9ec83981 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:46.376409 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-695b88ba-39ea-4188-bc1e-65ed9ec83981 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:46.377757 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-695b88ba-39ea-4188-bc1e-65ed9ec83981 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:46.378759 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-695b88ba-39ea-4188-bc1e-65ed9ec83981 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:46.380151 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-695b88ba-39ea-4188-bc1e-65ed9ec83981 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:46.382316 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-695b88ba-39ea-4188-bc1e-65ed9ec83981 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:46.384102 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:46.384740 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-695b88ba-39ea-4188-bc1e-65ed9ec83981 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:46.385795 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:46.394098 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:46.395506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:46.398753 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:46.407417 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:46.408127 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:46.408937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:47.055962 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:47.064942 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:47.066754 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:47.068145 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-dfc11554-b421-4a88-8feb-baf81c7afba3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.690030 Aug 12 06:48:47.079584 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 74/142] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:46 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:48:47.089577 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-695b88ba-39ea-4188-bc1e-65ed9ec83981 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:47.092575 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d7e14953-6a0b-4cf9-abf9-23125f2e822c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:47.093525 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d7e14953-6a0b-4cf9-abf9-23125f2e822c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:47.101316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7e14953-6a0b-4cf9-abf9-23125f2e822c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:47.102015 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7e14953-6a0b-4cf9-abf9-23125f2e822c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:47.102851 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7e14953-6a0b-4cf9-abf9-23125f2e822c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:47.103817 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7e14953-6a0b-4cf9-abf9-23125f2e822c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:47.104463 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7e14953-6a0b-4cf9-abf9-23125f2e822c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:47.105296 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7e14953-6a0b-4cf9-abf9-23125f2e822c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:47.120113 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-695b88ba-39ea-4188-bc1e-65ed9ec83981 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.769867 Aug 12 06:48:47.120708 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 69/143] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:46 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:47.359154 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d7e14953-6a0b-4cf9-abf9-23125f2e822c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:47.370494 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d7e14953-6a0b-4cf9-abf9-23125f2e822c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.288243 Aug 12 06:48:47.383743 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 75/144] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:47 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:47.724112 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-2bdb7c6e-958b-4abd-b358-8dded817ebbd req-7f08ee0d-b7dc-41e2-8a64-93c652039984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5e7e6c-f576-47c1-8fb5-407e318d15c4", "tag": "27e18af9-c038-4192-b7a5-a893995402b0"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:47.737241 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2bdb7c6e-958b-4abd-b358-8dded817ebbd req-7f08ee0d-b7dc-41e2-8a64-93c652039984 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:47.738166 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2bdb7c6e-958b-4abd-b358-8dded817ebbd req-7f08ee0d-b7dc-41e2-8a64-93c652039984 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:47.739079 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2bdb7c6e-958b-4abd-b358-8dded817ebbd req-7f08ee0d-b7dc-41e2-8a64-93c652039984 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:47.757857 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-2bdb7c6e-958b-4abd-b358-8dded817ebbd req-7f08ee0d-b7dc-41e2-8a64-93c652039984 service nova] Creating event network-changed:27e18af9-c038-4192-b7a5-a893995402b0 for instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 on hv-cinder-84457 Aug 12 06:48:47.764762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-2bdb7c6e-958b-4abd-b358-8dded817ebbd req-7f08ee0d-b7dc-41e2-8a64-93c652039984 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045070 Aug 12 06:48:47.766196 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 70/145] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:47.857685 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ea98763f-59a8-4b1a-b1c4-bd7e9aabd6b7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cafd904a-ab44-4155-a107-ffe016be063f"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:47.860890 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ea98763f-59a8-4b1a-b1c4-bd7e9aabd6b7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:47.868047 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea98763f-59a8-4b1a-b1c4-bd7e9aabd6b7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:47.868670 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea98763f-59a8-4b1a-b1c4-bd7e9aabd6b7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:47.869141 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea98763f-59a8-4b1a-b1c4-bd7e9aabd6b7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:47.870017 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea98763f-59a8-4b1a-b1c4-bd7e9aabd6b7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:47.870495 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea98763f-59a8-4b1a-b1c4-bd7e9aabd6b7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:47.871011 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea98763f-59a8-4b1a-b1c4-bd7e9aabd6b7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:48.100906 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:48.101810 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:48.119686 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:48.120628 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:48.122110 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:48.131188 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:48.132048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:48.132488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:48.406220 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:48.419461 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:48.421113 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:48.422318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-265e6290-dede-425f-b5c1-1b685b982be7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1407 microversion: 2.20 time: 0.327713 Aug 12 06:48:48.423143 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 71/146] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:48 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:48.428470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-389ce5ae-6ddb-4dda-accf-3ee7a61c34c7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:48.429447 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-389ce5ae-6ddb-4dda-accf-3ee7a61c34c7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:48.436408 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389ce5ae-6ddb-4dda-accf-3ee7a61c34c7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:48.437003 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389ce5ae-6ddb-4dda-accf-3ee7a61c34c7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:48.437756 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389ce5ae-6ddb-4dda-accf-3ee7a61c34c7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:48.438660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389ce5ae-6ddb-4dda-accf-3ee7a61c34c7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:48.439636 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389ce5ae-6ddb-4dda-accf-3ee7a61c34c7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:48.440141 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389ce5ae-6ddb-4dda-accf-3ee7a61c34c7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:48.577643 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-389ce5ae-6ddb-4dda-accf-3ee7a61c34c7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:48.588159 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-389ce5ae-6ddb-4dda-accf-3ee7a61c34c7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.163164 Aug 12 06:48:48.588998 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 72/147] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:48 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:48.596152 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-91f4904e-6fba-46e1-88be-188ebd69557c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:48.596776 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-91f4904e-6fba-46e1-88be-188ebd69557c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:48.604600 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91f4904e-6fba-46e1-88be-188ebd69557c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:48.605103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91f4904e-6fba-46e1-88be-188ebd69557c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:48.605521 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91f4904e-6fba-46e1-88be-188ebd69557c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:48.606231 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91f4904e-6fba-46e1-88be-188ebd69557c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:48.606866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91f4904e-6fba-46e1-88be-188ebd69557c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:48.607315 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91f4904e-6fba-46e1-88be-188ebd69557c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:48.763995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-91f4904e-6fba-46e1-88be-188ebd69557c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:48.772455 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-91f4904e-6fba-46e1-88be-188ebd69557c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.181913 Aug 12 06:48:48.773034 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 73/148] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:48 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:49.445955 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:49.446569 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:49.454943 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:49.456098 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:49.456849 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:49.457765 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:49.458434 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:49.459411 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:49.633468 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:49.642030 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:49.644291 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:49.645703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3fa3efe5-2881-429b-9537-efa423229bb8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1599 microversion: 2.20 time: 0.204297 Aug 12 06:48:49.646282 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 74/149] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:48:49 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1599 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:48:49.651894 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dcff5692-1e71-4578-9735-a6035e616f05 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:49.652785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dcff5692-1e71-4578-9735-a6035e616f05 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:49.658945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcff5692-1e71-4578-9735-a6035e616f05 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:49.659471 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcff5692-1e71-4578-9735-a6035e616f05 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:49.660068 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcff5692-1e71-4578-9735-a6035e616f05 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:49.660747 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcff5692-1e71-4578-9735-a6035e616f05 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:49.661426 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcff5692-1e71-4578-9735-a6035e616f05 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:49.662023 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcff5692-1e71-4578-9735-a6035e616f05 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:49.851629 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dcff5692-1e71-4578-9735-a6035e616f05 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:49.859310 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dcff5692-1e71-4578-9735-a6035e616f05 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1362 microversion: 2.1 time: 0.211413 Aug 12 06:48:49.859886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 75/150] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:49 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:49.864707 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2430b3a2-a315-4e82-af19-6d50e74b4fb6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:49.865199 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2430b3a2-a315-4e82-af19-6d50e74b4fb6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:49.871640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2430b3a2-a315-4e82-af19-6d50e74b4fb6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:49.872582 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2430b3a2-a315-4e82-af19-6d50e74b4fb6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:49.873235 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2430b3a2-a315-4e82-af19-6d50e74b4fb6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:49.874162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2430b3a2-a315-4e82-af19-6d50e74b4fb6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:49.874729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2430b3a2-a315-4e82-af19-6d50e74b4fb6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:49.875463 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2430b3a2-a315-4e82-af19-6d50e74b4fb6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:49.983919 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2430b3a2-a315-4e82-af19-6d50e74b4fb6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122710 Aug 12 06:48:49.985318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 76/151] 10.222.0.20 () {60 vars in 1316 bytes} [Fri Aug 12 06:48:49 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:48:49.995205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eec2ec50-125d-4adb-8a0a-7bc00de78200 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:49.995468 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eec2ec50-125d-4adb-8a0a-7bc00de78200 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:50.008899 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eec2ec50-125d-4adb-8a0a-7bc00de78200 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:50.009609 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eec2ec50-125d-4adb-8a0a-7bc00de78200 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:50.010547 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eec2ec50-125d-4adb-8a0a-7bc00de78200 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:50.012017 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eec2ec50-125d-4adb-8a0a-7bc00de78200 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:50.012645 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eec2ec50-125d-4adb-8a0a-7bc00de78200 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:50.013214 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eec2ec50-125d-4adb-8a0a-7bc00de78200 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:50.227191 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eec2ec50-125d-4adb-8a0a-7bc00de78200 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:50.237491 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eec2ec50-125d-4adb-8a0a-7bc00de78200 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.248179 Aug 12 06:48:50.240132 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 77/152] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:49 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:50.886128 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1809da1d-0ebe-4fab-923c-c666aa83e410 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:50.889294 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1809da1d-0ebe-4fab-923c-c666aa83e410 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:50.900259 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1809da1d-0ebe-4fab-923c-c666aa83e410 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:50.900878 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1809da1d-0ebe-4fab-923c-c666aa83e410 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:50.901542 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1809da1d-0ebe-4fab-923c-c666aa83e410 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:50.902425 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1809da1d-0ebe-4fab-923c-c666aa83e410 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:50.903051 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1809da1d-0ebe-4fab-923c-c666aa83e410 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:50.910074 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1809da1d-0ebe-4fab-923c-c666aa83e410 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:51.006092 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ea98763f-59a8-4b1a-b1c4-bd7e9aabd6b7 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "POST /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.152828 Aug 12 06:48:51.011206 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 76/153] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:48:47 2022] POST /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a/os-volume_attachments => generated 194 bytes in 3159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:51.174969 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1809da1d-0ebe-4fab-923c-c666aa83e410 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:51.184144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1809da1d-0ebe-4fab-923c-c666aa83e410 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1548 microversion: 2.1 time: 0.305896 Aug 12 06:48:51.203470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 78/154] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:50 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1548 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:48:51.214675 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-66c15303-d209-4eaa-a2fa-51ee98c24c24 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:51.215897 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-66c15303-d209-4eaa-a2fa-51ee98c24c24 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:51.225015 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:51.235421 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66c15303-d209-4eaa-a2fa-51ee98c24c24 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:51.242207 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66c15303-d209-4eaa-a2fa-51ee98c24c24 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:51.243417 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66c15303-d209-4eaa-a2fa-51ee98c24c24 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:51.246887 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66c15303-d209-4eaa-a2fa-51ee98c24c24 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:51.247762 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66c15303-d209-4eaa-a2fa-51ee98c24c24 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:51.248376 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66c15303-d209-4eaa-a2fa-51ee98c24c24 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:51.268902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4d2acef9-b5e5-4fb2-906a-3ed2496e5402 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:51.272232 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4d2acef9-b5e5-4fb2-906a-3ed2496e5402 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:51.288476 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d2acef9-b5e5-4fb2-906a-3ed2496e5402 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:51.289381 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d2acef9-b5e5-4fb2-906a-3ed2496e5402 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:51.290073 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d2acef9-b5e5-4fb2-906a-3ed2496e5402 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:51.291753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d2acef9-b5e5-4fb2-906a-3ed2496e5402 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:51.292846 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d2acef9-b5e5-4fb2-906a-3ed2496e5402 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:51.293450 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d2acef9-b5e5-4fb2-906a-3ed2496e5402 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:51.331686 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:48:51.424468 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-66c15303-d209-4eaa-a2fa-51ee98c24c24 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.219482 Aug 12 06:48:51.433982 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 77/155] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 06:48:51 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:51.557345 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4d2acef9-b5e5-4fb2-906a-3ed2496e5402 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:51.566600 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4d2acef9-b5e5-4fb2-906a-3ed2496e5402 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.310539 Aug 12 06:48:51.570966 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 79/156] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:51 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:51.930923 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-e6213c88-9a8c-4b56-a18e-3c0d5777cc75 req-694e9f38-3ab7-4942-a3d3-7e9126c451c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6bc12e0-d758-47a7-920d-971a6e993711", "tag": "2de31bfc-bbcb-4a81-989c-adfbe72a2aac"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:51.945657 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e6213c88-9a8c-4b56-a18e-3c0d5777cc75 req-694e9f38-3ab7-4942-a3d3-7e9126c451c8 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:51.947479 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e6213c88-9a8c-4b56-a18e-3c0d5777cc75 req-694e9f38-3ab7-4942-a3d3-7e9126c451c8 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:51.948238 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e6213c88-9a8c-4b56-a18e-3c0d5777cc75 req-694e9f38-3ab7-4942-a3d3-7e9126c451c8 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:51.968101 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-e6213c88-9a8c-4b56-a18e-3c0d5777cc75 req-694e9f38-3ab7-4942-a3d3-7e9126c451c8 service nova] Creating event network-changed:2de31bfc-bbcb-4a81-989c-adfbe72a2aac for instance a6bc12e0-d758-47a7-920d-971a6e993711 on hv-cinder-84457 Aug 12 06:48:51.974379 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-e6213c88-9a8c-4b56-a18e-3c0d5777cc75 req-694e9f38-3ab7-4942-a3d3-7e9126c451c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047398 Aug 12 06:48:51.975573 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 78/157] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:52.588965 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2d16a685-dd9f-4f59-836f-f041f1a79dc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:52.590196 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2d16a685-dd9f-4f59-836f-f041f1a79dc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:52.596973 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d16a685-dd9f-4f59-836f-f041f1a79dc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:52.597733 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d16a685-dd9f-4f59-836f-f041f1a79dc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:52.598366 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d16a685-dd9f-4f59-836f-f041f1a79dc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:52.599312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d16a685-dd9f-4f59-836f-f041f1a79dc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:52.599986 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d16a685-dd9f-4f59-836f-f041f1a79dc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:52.600602 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d16a685-dd9f-4f59-836f-f041f1a79dc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:52.779985 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2d16a685-dd9f-4f59-836f-f041f1a79dc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:52.792922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2d16a685-dd9f-4f59-836f-f041f1a79dc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.208939 Aug 12 06:48:52.796895 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:52 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:53.815431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-273e8329-d67d-4c09-a70d-523c3578335a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:53.817474 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-273e8329-d67d-4c09-a70d-523c3578335a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:53.825092 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-273e8329-d67d-4c09-a70d-523c3578335a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:53.825821 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-273e8329-d67d-4c09-a70d-523c3578335a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:53.826300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-273e8329-d67d-4c09-a70d-523c3578335a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:53.827103 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-273e8329-d67d-4c09-a70d-523c3578335a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:53.827738 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-273e8329-d67d-4c09-a70d-523c3578335a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:53.828230 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-273e8329-d67d-4c09-a70d-523c3578335a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:54.000132 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-16400d9f-6b80-49bf-9bc5-4d542afa4645 req-e07f0136-f405-45d3-b27d-3d39874d507e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6cd9b2-0e48-4ace-96c2-ba691c366ae1", "tag": "3e7b26bb-9495-4cbe-a8c3-ab4dc50cc862"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:48:54.015434 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-16400d9f-6b80-49bf-9bc5-4d542afa4645 req-e07f0136-f405-45d3-b27d-3d39874d507e service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:54.016456 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-16400d9f-6b80-49bf-9bc5-4d542afa4645 req-e07f0136-f405-45d3-b27d-3d39874d507e service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:54.017162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-16400d9f-6b80-49bf-9bc5-4d542afa4645 req-e07f0136-f405-45d3-b27d-3d39874d507e service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:54.038345 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-16400d9f-6b80-49bf-9bc5-4d542afa4645 req-e07f0136-f405-45d3-b27d-3d39874d507e service nova] Creating event network-changed:3e7b26bb-9495-4cbe-a8c3-ab4dc50cc862 for instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 on hv-cinder-84457 Aug 12 06:48:54.047177 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-16400d9f-6b80-49bf-9bc5-4d542afa4645 req-e07f0136-f405-45d3-b27d-3d39874d507e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052646 Aug 12 06:48:54.056273 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 81/159] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:48:54.069894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-273e8329-d67d-4c09-a70d-523c3578335a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:54.079560 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-273e8329-d67d-4c09-a70d-523c3578335a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.269304 Aug 12 06:48:54.091862 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 79/160] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:53 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:55.103004 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a93b916d-039a-4529-91d1-fdfaf020b65f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:55.104061 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a93b916d-039a-4529-91d1-fdfaf020b65f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:55.110014 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a93b916d-039a-4529-91d1-fdfaf020b65f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:55.110505 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a93b916d-039a-4529-91d1-fdfaf020b65f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:55.110928 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a93b916d-039a-4529-91d1-fdfaf020b65f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:55.111647 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a93b916d-039a-4529-91d1-fdfaf020b65f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:55.112093 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a93b916d-039a-4529-91d1-fdfaf020b65f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:55.112502 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a93b916d-039a-4529-91d1-fdfaf020b65f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:55.272598 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a93b916d-039a-4529-91d1-fdfaf020b65f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:55.293874 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a93b916d-039a-4529-91d1-fdfaf020b65f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.181986 Aug 12 06:48:55.293874 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 82/161] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:55 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:56.305551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9636d5bd-e9bc-4fb0-9a8f-c46f10772c6d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:56.306163 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9636d5bd-e9bc-4fb0-9a8f-c46f10772c6d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:56.312486 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9636d5bd-e9bc-4fb0-9a8f-c46f10772c6d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:56.312938 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9636d5bd-e9bc-4fb0-9a8f-c46f10772c6d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:56.313652 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9636d5bd-e9bc-4fb0-9a8f-c46f10772c6d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:56.314506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9636d5bd-e9bc-4fb0-9a8f-c46f10772c6d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:56.314952 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9636d5bd-e9bc-4fb0-9a8f-c46f10772c6d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:56.315391 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9636d5bd-e9bc-4fb0-9a8f-c46f10772c6d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:56.498443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9636d5bd-e9bc-4fb0-9a8f-c46f10772c6d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:56.512463 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9636d5bd-e9bc-4fb0-9a8f-c46f10772c6d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.211093 Aug 12 06:48:56.513312 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 80/162] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:56 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:57.534074 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d48ecbd9-5e1a-429f-b8d0-8031dcd798ed tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:57.534798 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d48ecbd9-5e1a-429f-b8d0-8031dcd798ed tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:57.541187 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d48ecbd9-5e1a-429f-b8d0-8031dcd798ed tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:57.541713 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d48ecbd9-5e1a-429f-b8d0-8031dcd798ed tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:57.542069 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d48ecbd9-5e1a-429f-b8d0-8031dcd798ed tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:57.543106 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d48ecbd9-5e1a-429f-b8d0-8031dcd798ed tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:57.543609 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d48ecbd9-5e1a-429f-b8d0-8031dcd798ed tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:57.543960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d48ecbd9-5e1a-429f-b8d0-8031dcd798ed tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:57.696559 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d48ecbd9-5e1a-429f-b8d0-8031dcd798ed tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:57.705693 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d48ecbd9-5e1a-429f-b8d0-8031dcd798ed tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.175375 Aug 12 06:48:57.706302 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 83/163] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:57 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:58.726068 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e99ca249-158a-42fa-a6c7-cfe61966bedf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:58.726725 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e99ca249-158a-42fa-a6c7-cfe61966bedf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:58.733184 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e99ca249-158a-42fa-a6c7-cfe61966bedf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:58.733689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e99ca249-158a-42fa-a6c7-cfe61966bedf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:58.734193 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e99ca249-158a-42fa-a6c7-cfe61966bedf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:58.735068 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e99ca249-158a-42fa-a6c7-cfe61966bedf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:58.735527 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e99ca249-158a-42fa-a6c7-cfe61966bedf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:58.736032 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e99ca249-158a-42fa-a6c7-cfe61966bedf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:58.881623 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e99ca249-158a-42fa-a6c7-cfe61966bedf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:48:58.889272 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e99ca249-158a-42fa-a6c7-cfe61966bedf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.167387 Aug 12 06:48:58.889854 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 81/164] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:58 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:48:59.911301 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fce1d39b-565e-4fdd-b4fc-279fedb25a7d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:48:59.911831 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fce1d39b-565e-4fdd-b4fc-279fedb25a7d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:48:59.918387 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fce1d39b-565e-4fdd-b4fc-279fedb25a7d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:59.919026 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fce1d39b-565e-4fdd-b4fc-279fedb25a7d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:59.919459 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fce1d39b-565e-4fdd-b4fc-279fedb25a7d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:48:59.920323 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fce1d39b-565e-4fdd-b4fc-279fedb25a7d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:48:59.920740 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fce1d39b-565e-4fdd-b4fc-279fedb25a7d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:48:59.921192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fce1d39b-565e-4fdd-b4fc-279fedb25a7d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:00.064377 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fce1d39b-565e-4fdd-b4fc-279fedb25a7d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:00.073167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fce1d39b-565e-4fdd-b4fc-279fedb25a7d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.165817 Aug 12 06:49:00.073823 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 84/165] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:48:59 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:01.095143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b30c6ca2-e0f7-4ebc-a59b-0d5e97f3a787 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:01.096279 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b30c6ca2-e0f7-4ebc-a59b-0d5e97f3a787 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:01.103310 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c6ca2-e0f7-4ebc-a59b-0d5e97f3a787 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:01.103979 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c6ca2-e0f7-4ebc-a59b-0d5e97f3a787 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:01.104561 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c6ca2-e0f7-4ebc-a59b-0d5e97f3a787 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:01.105516 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c6ca2-e0f7-4ebc-a59b-0d5e97f3a787 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:01.106173 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c6ca2-e0f7-4ebc-a59b-0d5e97f3a787 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:01.106917 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c6ca2-e0f7-4ebc-a59b-0d5e97f3a787 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:01.287239 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b30c6ca2-e0f7-4ebc-a59b-0d5e97f3a787 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:01.296582 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b30c6ca2-e0f7-4ebc-a59b-0d5e97f3a787 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.205482 Aug 12 06:49:01.297408 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 82/166] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:01 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:01.954669 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ce01f1d5-1edd-429f-a903-1a6cf3b70d0e tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:01.955285 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ce01f1d5-1edd-429f-a903-1a6cf3b70d0e tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:01.961084 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce01f1d5-1edd-429f-a903-1a6cf3b70d0e tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:01.961625 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce01f1d5-1edd-429f-a903-1a6cf3b70d0e tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:01.962060 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce01f1d5-1edd-429f-a903-1a6cf3b70d0e tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:01.962753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce01f1d5-1edd-429f-a903-1a6cf3b70d0e tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:01.963227 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce01f1d5-1edd-429f-a903-1a6cf3b70d0e tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:01.963637 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce01f1d5-1edd-429f-a903-1a6cf3b70d0e tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:01.988022 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ce01f1d5-1edd-429f-a903-1a6cf3b70d0e tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:49:02.088049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ce01f1d5-1edd-429f-a903-1a6cf3b70d0e tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 204 len: 0 microversion: 2.1 time: 0.136963 Aug 12 06:49:02.089052 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 85/167] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:49:01 2022] DELETE /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 06:49:02.097726 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ece1c782-7a43-4ea8-8627-083ddcd7c617 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:02.098952 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ece1c782-7a43-4ea8-8627-083ddcd7c617 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:02.105459 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ece1c782-7a43-4ea8-8627-083ddcd7c617 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:02.106051 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ece1c782-7a43-4ea8-8627-083ddcd7c617 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:02.106675 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ece1c782-7a43-4ea8-8627-083ddcd7c617 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:02.107546 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ece1c782-7a43-4ea8-8627-083ddcd7c617 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:02.107850 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ece1c782-7a43-4ea8-8627-083ddcd7c617 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:02.108291 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ece1c782-7a43-4ea8-8627-083ddcd7c617 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:02.112537 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:49:02.244531 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ece1c782-7a43-4ea8-8627-083ddcd7c617 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:02.253699 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ece1c782-7a43-4ea8-8627-083ddcd7c617 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1553 microversion: 2.1 time: 0.159955 Aug 12 06:49:02.254256 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 83/168] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:02 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:02.318453 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-acbde640-f1c5-40ff-9741-47ea89ad4481 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:02.319386 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-acbde640-f1c5-40ff-9741-47ea89ad4481 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:02.325764 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acbde640-f1c5-40ff-9741-47ea89ad4481 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:02.326321 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acbde640-f1c5-40ff-9741-47ea89ad4481 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:02.326852 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acbde640-f1c5-40ff-9741-47ea89ad4481 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:02.328030 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acbde640-f1c5-40ff-9741-47ea89ad4481 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:02.328547 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acbde640-f1c5-40ff-9741-47ea89ad4481 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:02.329020 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acbde640-f1c5-40ff-9741-47ea89ad4481 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:02.471768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-acbde640-f1c5-40ff-9741-47ea89ad4481 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:02.480396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-acbde640-f1c5-40ff-9741-47ea89ad4481 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.166224 Aug 12 06:49:02.481307 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 86/169] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:02 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:03.276329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-383052c8-ccd6-47b6-a976-f70d7858450a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:03.279215 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-383052c8-ccd6-47b6-a976-f70d7858450a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:03.286211 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-383052c8-ccd6-47b6-a976-f70d7858450a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:03.286914 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-383052c8-ccd6-47b6-a976-f70d7858450a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:03.287358 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-383052c8-ccd6-47b6-a976-f70d7858450a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:03.288057 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-383052c8-ccd6-47b6-a976-f70d7858450a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:03.288540 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-383052c8-ccd6-47b6-a976-f70d7858450a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:03.288909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-383052c8-ccd6-47b6-a976-f70d7858450a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:03.429340 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-383052c8-ccd6-47b6-a976-f70d7858450a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:03.436017 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-383052c8-ccd6-47b6-a976-f70d7858450a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1553 microversion: 2.1 time: 0.164652 Aug 12 06:49:03.436640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 84/170] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:03 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:03.501476 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-57335901-015b-4a91-bb6b-e167dd1181fc tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:03.502073 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-57335901-015b-4a91-bb6b-e167dd1181fc tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:03.513488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57335901-015b-4a91-bb6b-e167dd1181fc tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:03.514156 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57335901-015b-4a91-bb6b-e167dd1181fc tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:03.514653 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57335901-015b-4a91-bb6b-e167dd1181fc tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:03.515420 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57335901-015b-4a91-bb6b-e167dd1181fc tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:03.515880 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57335901-015b-4a91-bb6b-e167dd1181fc tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:03.516308 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57335901-015b-4a91-bb6b-e167dd1181fc tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:03.655864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-57335901-015b-4a91-bb6b-e167dd1181fc tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:03.665059 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-57335901-015b-4a91-bb6b-e167dd1181fc tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.167225 Aug 12 06:49:03.665968 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 87/171] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:03 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:04.461266 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-db9931b7-72c5-41fc-a02b-92a125a47996 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:04.462280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-db9931b7-72c5-41fc-a02b-92a125a47996 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:04.472712 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db9931b7-72c5-41fc-a02b-92a125a47996 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:04.473502 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db9931b7-72c5-41fc-a02b-92a125a47996 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:04.474197 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db9931b7-72c5-41fc-a02b-92a125a47996 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:04.475394 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db9931b7-72c5-41fc-a02b-92a125a47996 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:04.476147 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db9931b7-72c5-41fc-a02b-92a125a47996 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:04.476833 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db9931b7-72c5-41fc-a02b-92a125a47996 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:04.607676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-db9931b7-72c5-41fc-a02b-92a125a47996 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:04.619749 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-db9931b7-72c5-41fc-a02b-92a125a47996 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1553 microversion: 2.1 time: 0.164789 Aug 12 06:49:04.620607 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 85/172] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:04 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:04.685900 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b6d186e2-94c0-4466-a9cb-e87797c81504 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:04.686487 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b6d186e2-94c0-4466-a9cb-e87797c81504 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:04.693898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6d186e2-94c0-4466-a9cb-e87797c81504 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:04.693898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6d186e2-94c0-4466-a9cb-e87797c81504 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:04.693898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6d186e2-94c0-4466-a9cb-e87797c81504 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:04.693898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6d186e2-94c0-4466-a9cb-e87797c81504 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:04.696269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6d186e2-94c0-4466-a9cb-e87797c81504 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:04.696269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6d186e2-94c0-4466-a9cb-e87797c81504 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:04.824500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b6d186e2-94c0-4466-a9cb-e87797c81504 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:04.831945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b6d186e2-94c0-4466-a9cb-e87797c81504 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.150073 Aug 12 06:49:04.832500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 88/173] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:04 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:05.644863 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-949ad9d2-bf20-4f9a-b862-c5e8c581cc26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:05.645883 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-949ad9d2-bf20-4f9a-b862-c5e8c581cc26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:05.656952 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-949ad9d2-bf20-4f9a-b862-c5e8c581cc26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:05.657740 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-949ad9d2-bf20-4f9a-b862-c5e8c581cc26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:05.658444 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-949ad9d2-bf20-4f9a-b862-c5e8c581cc26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:05.659623 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-949ad9d2-bf20-4f9a-b862-c5e8c581cc26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:05.660368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-949ad9d2-bf20-4f9a-b862-c5e8c581cc26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:05.661216 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-949ad9d2-bf20-4f9a-b862-c5e8c581cc26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:05.806722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-949ad9d2-bf20-4f9a-b862-c5e8c581cc26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:05.814927 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-949ad9d2-bf20-4f9a-b862-c5e8c581cc26 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1553 microversion: 2.1 time: 0.176483 Aug 12 06:49:05.815520 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 86/174] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:05 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:05.852336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5f87cae7-1a2c-48b6-a813-6caa2ef43174 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:05.852988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5f87cae7-1a2c-48b6-a813-6caa2ef43174 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:05.859223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f87cae7-1a2c-48b6-a813-6caa2ef43174 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:05.859702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f87cae7-1a2c-48b6-a813-6caa2ef43174 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:05.860127 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f87cae7-1a2c-48b6-a813-6caa2ef43174 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:05.860795 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f87cae7-1a2c-48b6-a813-6caa2ef43174 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:05.861233 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f87cae7-1a2c-48b6-a813-6caa2ef43174 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:05.861640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f87cae7-1a2c-48b6-a813-6caa2ef43174 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:05.998787 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5f87cae7-1a2c-48b6-a813-6caa2ef43174 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:06.007016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5f87cae7-1a2c-48b6-a813-6caa2ef43174 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.158514 Aug 12 06:49:06.007604 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 89/175] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:05 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:06.835951 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6863c1b1-e008-42c4-86db-7603febab337 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:06.836551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6863c1b1-e008-42c4-86db-7603febab337 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:06.842903 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6863c1b1-e008-42c4-86db-7603febab337 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:06.843403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6863c1b1-e008-42c4-86db-7603febab337 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:06.843827 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6863c1b1-e008-42c4-86db-7603febab337 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:06.844502 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6863c1b1-e008-42c4-86db-7603febab337 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:06.844943 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6863c1b1-e008-42c4-86db-7603febab337 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:06.845350 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6863c1b1-e008-42c4-86db-7603febab337 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:06.996069 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6863c1b1-e008-42c4-86db-7603febab337 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:07.004209 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6863c1b1-e008-42c4-86db-7603febab337 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1553 microversion: 2.1 time: 0.172071 Aug 12 06:49:07.004774 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 87/176] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:06 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:49:07.029261 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-60f68d30-064f-4ec5-82e6-57f81f33cbe9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:07.029926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-60f68d30-064f-4ec5-82e6-57f81f33cbe9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:07.036163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60f68d30-064f-4ec5-82e6-57f81f33cbe9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:07.036638 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60f68d30-064f-4ec5-82e6-57f81f33cbe9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:07.037171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60f68d30-064f-4ec5-82e6-57f81f33cbe9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:07.037848 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60f68d30-064f-4ec5-82e6-57f81f33cbe9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:07.038289 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60f68d30-064f-4ec5-82e6-57f81f33cbe9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:07.038699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60f68d30-064f-4ec5-82e6-57f81f33cbe9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:07.172699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-60f68d30-064f-4ec5-82e6-57f81f33cbe9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:07.180632 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-60f68d30-064f-4ec5-82e6-57f81f33cbe9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.155581 Aug 12 06:49:07.181361 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 90/177] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:07 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:08.026457 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-39d45571-b019-4ec1-a314-b72e0af0c248 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:08.027753 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-39d45571-b019-4ec1-a314-b72e0af0c248 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:08.034077 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39d45571-b019-4ec1-a314-b72e0af0c248 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:08.034612 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39d45571-b019-4ec1-a314-b72e0af0c248 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:08.035239 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39d45571-b019-4ec1-a314-b72e0af0c248 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:08.035915 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39d45571-b019-4ec1-a314-b72e0af0c248 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:08.036429 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39d45571-b019-4ec1-a314-b72e0af0c248 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:08.037052 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-39d45571-b019-4ec1-a314-b72e0af0c248 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:08.131997 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-39d45571-b019-4ec1-a314-b72e0af0c248 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:08.141999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-39d45571-b019-4ec1-a314-b72e0af0c248 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1511 microversion: 2.1 time: 0.120021 Aug 12 06:49:08.142951 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 88/178] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:08 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1511 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:08.206708 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6e392331-cd06-4f63-afef-397b56711834 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:08.208189 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6e392331-cd06-4f63-afef-397b56711834 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:08.218585 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e392331-cd06-4f63-afef-397b56711834 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:08.219341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e392331-cd06-4f63-afef-397b56711834 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:08.220082 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e392331-cd06-4f63-afef-397b56711834 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:08.221139 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e392331-cd06-4f63-afef-397b56711834 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:08.221750 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e392331-cd06-4f63-afef-397b56711834 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:08.222353 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e392331-cd06-4f63-afef-397b56711834 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:08.246822 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-592dea78-a2e7-4d67-a312-ad604b6f330c req-9f2d5de6-21c8-4034-b0bc-6b13fda421e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67edb8b-4485-4696-9f6a-bb7138745e8a", "name": "network-vif-deleted", "tag": "13351888-408a-44b4-b929-ce7da277b2ea"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:49:08.257801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-592dea78-a2e7-4d67-a312-ad604b6f330c req-9f2d5de6-21c8-4034-b0bc-6b13fda421e0 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:08.261439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-592dea78-a2e7-4d67-a312-ad604b6f330c req-9f2d5de6-21c8-4034-b0bc-6b13fda421e0 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:08.261439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-592dea78-a2e7-4d67-a312-ad604b6f330c req-9f2d5de6-21c8-4034-b0bc-6b13fda421e0 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:08.274480 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-592dea78-a2e7-4d67-a312-ad604b6f330c req-9f2d5de6-21c8-4034-b0bc-6b13fda421e0 service nova] Creating event network-vif-deleted:13351888-408a-44b4-b929-ce7da277b2ea for instance d67edb8b-4485-4696-9f6a-bb7138745e8a on hv-cinder-84457 Aug 12 06:49:08.285922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-592dea78-a2e7-4d67-a312-ad604b6f330c req-9f2d5de6-21c8-4034-b0bc-6b13fda421e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043133 Aug 12 06:49:08.287624 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 89/179] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:49:08.413639 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6e392331-cd06-4f63-afef-397b56711834 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:08.421470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6e392331-cd06-4f63-afef-397b56711834 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.222670 Aug 12 06:49:08.421976 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 91/180] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:08 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:09.163952 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:09.164584 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:09.171886 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:09.172683 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:09.173112 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:09.173765 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:09.174385 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:09.174802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:09.210566 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:09.211133 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:09.211552 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:09.212386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lazy-loading 'fault' on Instance uuid d67edb8b-4485-4696-9f6a-bb7138745e8a {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:49:09.269506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db4d3f63b3b54993b59d69af08d69218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efb9fc8b8544edaac9d5dcf5dc18d66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:09.279536 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-99f11d9b-d724-4777-8441-3b3fc682876a tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 200 len: 1350 microversion: 2.1 time: 0.119954 Aug 12 06:49:09.291521 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 90/181] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:09 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 1350 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:09.443623 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8e6f9e25-8af6-4269-985b-3d150a85eb3e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:09.444249 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8e6f9e25-8af6-4269-985b-3d150a85eb3e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:09.452197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e6f9e25-8af6-4269-985b-3d150a85eb3e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:09.453059 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e6f9e25-8af6-4269-985b-3d150a85eb3e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:09.455185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e6f9e25-8af6-4269-985b-3d150a85eb3e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:09.456584 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e6f9e25-8af6-4269-985b-3d150a85eb3e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:09.457332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e6f9e25-8af6-4269-985b-3d150a85eb3e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:09.457965 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e6f9e25-8af6-4269-985b-3d150a85eb3e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:09.601173 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8e6f9e25-8af6-4269-985b-3d150a85eb3e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:09.612196 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8e6f9e25-8af6-4269-985b-3d150a85eb3e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.174123 Aug 12 06:49:09.612859 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 92/182] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:09 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:10.302657 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:10.303829 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:10.311842 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:10.312507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:10.313211 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:10.314141 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:10.314830 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:10.315617 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:10.331864 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] HTTP exception thrown: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Request method failure captured: Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a HTTP/1.1 Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fet36k6D05aW8IcyTHS8qMoK-Jas0q63q4RayDwkhEFPCBhe47S7Ub_ZkK-es0scmVEANv4TOhHB8lgE6OP6R60eKURy3dufRil55mWmY9Bpbz7lyHT7Dbgg2e-2ov3Hd1dnvuVAuHXm-g-hgFIcZOlV4KRJvuAhicTm9LtxBfFocs Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 1efb9fc8b8544edaac9d5dcf5dc18d66 Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:49:10.345412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1efb9fc8b8544edaac9d5dcf5dc18d66", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 1efb9fc8b8544edaac9d5dcf5dc18d66 Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-DeleteServersTestJSON-669152538-project Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: db4d3f63b3b54993b59d69af08d69218 Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-DeleteServersTestJSON-669152538-project Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:10.346898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': 'd67edb8b-4485-4696-9f6a-bb7138745e8a'} Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:49:10.347836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:10.349220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:49:10.350738 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Returning 404 to user: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:49:10.351658 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6a186de9-a904-4a18-a275-fe82d9fdd659 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 404 len: 111 microversion: 2.1 time: 0.054065 Aug 12 06:49:10.352382 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 91/183] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:10 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:49:10.479075 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:10.494864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:10.501322 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:10.502088 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:10.502519 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:10.503243 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:10.503892 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:10.504470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:10.520588 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] HTTP exception thrown: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Request method failure captured: Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a/os-volume_attachments HTTP/1.1 Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9fet36k6D05aW8IcyTHS8qMoK-Jas0q63q4RayDwkhEFPCBhe47S7Ub_ZkK-es0scmVEANv4TOhHB8lgE6OP6R60eKURy3dufRil55mWmY9Bpbz7lyHT7Dbgg2e-2ov3Hd1dnvuVAuHXm-g-hgFIcZOlV4KRJvuAhicTm9LtxBfFocs Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 1efb9fc8b8544edaac9d5dcf5dc18d66 Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:49:10.532603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1efb9fc8b8544edaac9d5dcf5dc18d66", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 1efb9fc8b8544edaac9d5dcf5dc18d66 Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-DeleteServersTestJSON-669152538-project Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: db4d3f63b3b54993b59d69af08d69218 Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-DeleteServersTestJSON-669152538-project Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:10.533861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'server_id': 'd67edb8b-4485-4696-9f6a-bb7138745e8a'} Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:49:10.534551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:10.536615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:49:10.538066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Returning 404 to user: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:49:10.538066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6db63d82-4a25-4293-83c6-2c7a95b3fedd tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059664 Aug 12 06:49:10.538066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 93/184] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:49:10 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:49:10.633300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-94559a1c-30ba-41f2-8cc2-4aced58b119e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:10.637295 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-94559a1c-30ba-41f2-8cc2-4aced58b119e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:10.648340 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-94559a1c-30ba-41f2-8cc2-4aced58b119e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:10.648820 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-94559a1c-30ba-41f2-8cc2-4aced58b119e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:10.649262 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-94559a1c-30ba-41f2-8cc2-4aced58b119e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:10.649887 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-94559a1c-30ba-41f2-8cc2-4aced58b119e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:10.650361 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-94559a1c-30ba-41f2-8cc2-4aced58b119e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:10.650826 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-94559a1c-30ba-41f2-8cc2-4aced58b119e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:10.867148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-94559a1c-30ba-41f2-8cc2-4aced58b119e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:10.876696 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-94559a1c-30ba-41f2-8cc2-4aced58b119e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.246982 Aug 12 06:49:10.877536 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 92/185] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:10 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:11.786932 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:11.787483 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:11.789427 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:49:11.795675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:11.796127 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:11.796551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:11.797248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:11.797724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:11.798133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:11.812004 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] HTTP exception thrown: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Request method failure captured: Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a HTTP/1.1 Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9fet36k6D05aW8IcyTHS8qMoK-Jas0q63q4RayDwkhEFPCBhe47S7Ub_ZkK-es0scmVEANv4TOhHB8lgE6OP6R60eKURy3dufRil55mWmY9Bpbz7lyHT7Dbgg2e-2ov3Hd1dnvuVAuHXm-g-hgFIcZOlV4KRJvuAhicTm9LtxBfFocs Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 1efb9fc8b8544edaac9d5dcf5dc18d66 Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:49:11.814162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1efb9fc8b8544edaac9d5dcf5dc18d66", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 1efb9fc8b8544edaac9d5dcf5dc18d66 Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-DeleteServersTestJSON-669152538-project Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: db4d3f63b3b54993b59d69af08d69218 Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-DeleteServersTestJSON-669152538-project Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:11.815579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': 'd67edb8b-4485-4696-9f6a-bb7138745e8a'} Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:49:11.816257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:11.817299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:49:11.818351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Returning 404 to user: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:49:11.818351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6bfa799f-e2c1-4524-ba5b-aa4e1e594ac3 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 404 len: 111 microversion: 2.1 time: 0.032568 Aug 12 06:49:11.818351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 94/186] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:49:11 2022] DELETE /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:49:11.825099 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:11.825699 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] [instance: d67edb8b-4485-4696-9f6a-bb7138745e8a] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:11.832512 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:11.832997 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:11.833428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:11.834122 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:11.834572 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:11.835031 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:11.848376 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] HTTP exception thrown: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Request method failure captured: Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a HTTP/1.1 Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fet36k6D05aW8IcyTHS8qMoK-Jas0q63q4RayDwkhEFPCBhe47S7Ub_ZkK-es0scmVEANv4TOhHB8lgE6OP6R60eKURy3dufRil55mWmY9Bpbz7lyHT7Dbgg2e-2ov3Hd1dnvuVAuHXm-g-hgFIcZOlV4KRJvuAhicTm9LtxBfFocs Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 1efb9fc8b8544edaac9d5dcf5dc18d66 Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:49:11.849926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1efb9fc8b8544edaac9d5dcf5dc18d66", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1efb9fc8b8544edaac9d5dcf5dc18d66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 1efb9fc8b8544edaac9d5dcf5dc18d66 Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-DeleteServersTestJSON-669152538 Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-DeleteServersTestJSON-669152538-project Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: db4d3f63b3b54993b59d69af08d69218 Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-DeleteServersTestJSON-669152538-project Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:11.851439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': 'd67edb8b-4485-4696-9f6a-bb7138745e8a'} Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:49:11.852368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. Aug 12 06:49:11.853928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:49:11.855634 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] Returning 404 to user: Instance d67edb8b-4485-4696-9f6a-bb7138745e8a could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:49:11.855634 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f571f1e7-dfc9-403f-954b-de55f80a8033 tempest-DeleteServersTestJSON-669152538 tempest-DeleteServersTestJSON-669152538-project] 10.222.0.20 "GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a" status: 404 len: 111 microversion: 2.1 time: 0.030565 Aug 12 06:49:11.855634 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 93/187] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:11 2022] GET /compute/v2.1/servers/d67edb8b-4485-4696-9f6a-bb7138745e8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:49:11.898280 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d0400ce8-20b5-4cb1-b3cb-d3ee173c3b1d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:11.898870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d0400ce8-20b5-4cb1-b3cb-d3ee173c3b1d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:11.904802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0400ce8-20b5-4cb1-b3cb-d3ee173c3b1d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:11.905278 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0400ce8-20b5-4cb1-b3cb-d3ee173c3b1d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:11.905699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0400ce8-20b5-4cb1-b3cb-d3ee173c3b1d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:11.906379 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0400ce8-20b5-4cb1-b3cb-d3ee173c3b1d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:11.906817 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0400ce8-20b5-4cb1-b3cb-d3ee173c3b1d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:11.907251 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0400ce8-20b5-4cb1-b3cb-d3ee173c3b1d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:12.037802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d0400ce8-20b5-4cb1-b3cb-d3ee173c3b1d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:12.047195 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d0400ce8-20b5-4cb1-b3cb-d3ee173c3b1d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.153097 Aug 12 06:49:12.047870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 95/188] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:11 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:13.069227 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-87e40d75-95b9-40da-814e-62778b98a433 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:13.071418 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-87e40d75-95b9-40da-814e-62778b98a433 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:13.078374 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87e40d75-95b9-40da-814e-62778b98a433 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:13.078858 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87e40d75-95b9-40da-814e-62778b98a433 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:13.079313 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87e40d75-95b9-40da-814e-62778b98a433 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:13.080006 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87e40d75-95b9-40da-814e-62778b98a433 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:13.080616 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87e40d75-95b9-40da-814e-62778b98a433 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:13.081191 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87e40d75-95b9-40da-814e-62778b98a433 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:13.260945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-87e40d75-95b9-40da-814e-62778b98a433 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:13.274895 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-87e40d75-95b9-40da-814e-62778b98a433 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.210278 Aug 12 06:49:13.276261 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 94/189] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:13 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:14.297227 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-43336ee9-de8e-4002-a895-16ebffaad7fd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:14.297833 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-43336ee9-de8e-4002-a895-16ebffaad7fd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:14.304020 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43336ee9-de8e-4002-a895-16ebffaad7fd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:14.304523 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43336ee9-de8e-4002-a895-16ebffaad7fd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:14.304947 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43336ee9-de8e-4002-a895-16ebffaad7fd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:14.305658 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43336ee9-de8e-4002-a895-16ebffaad7fd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:14.306137 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43336ee9-de8e-4002-a895-16ebffaad7fd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:14.306568 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43336ee9-de8e-4002-a895-16ebffaad7fd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:14.311430 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:49:14.551602 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-43336ee9-de8e-4002-a895-16ebffaad7fd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:14.563357 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-43336ee9-de8e-4002-a895-16ebffaad7fd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.270561 Aug 12 06:49:14.580348 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 96/190] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:14 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:15.585809 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1dc53abc-6842-4abc-b16f-e2a272ff7f38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:15.587213 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1dc53abc-6842-4abc-b16f-e2a272ff7f38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:15.594367 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1dc53abc-6842-4abc-b16f-e2a272ff7f38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:15.594854 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1dc53abc-6842-4abc-b16f-e2a272ff7f38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:15.595336 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1dc53abc-6842-4abc-b16f-e2a272ff7f38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:15.596033 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1dc53abc-6842-4abc-b16f-e2a272ff7f38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:15.596490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1dc53abc-6842-4abc-b16f-e2a272ff7f38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:15.596910 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1dc53abc-6842-4abc-b16f-e2a272ff7f38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:15.735714 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1dc53abc-6842-4abc-b16f-e2a272ff7f38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:15.744087 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1dc53abc-6842-4abc-b16f-e2a272ff7f38 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.162109 Aug 12 06:49:15.746144 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 95/191] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:15 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:16.766229 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8edf53f5-cb6c-4ec2-97ab-71e866423d16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:16.766909 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8edf53f5-cb6c-4ec2-97ab-71e866423d16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:16.773260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8edf53f5-cb6c-4ec2-97ab-71e866423d16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:16.773722 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8edf53f5-cb6c-4ec2-97ab-71e866423d16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:16.774142 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8edf53f5-cb6c-4ec2-97ab-71e866423d16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:16.774822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8edf53f5-cb6c-4ec2-97ab-71e866423d16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:16.775311 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8edf53f5-cb6c-4ec2-97ab-71e866423d16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:16.775719 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8edf53f5-cb6c-4ec2-97ab-71e866423d16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:16.907515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8edf53f5-cb6c-4ec2-97ab-71e866423d16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:16.915492 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8edf53f5-cb6c-4ec2-97ab-71e866423d16 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.152945 Aug 12 06:49:16.916549 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 97/192] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:16 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:17.936518 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ef87ad44-d5c0-4776-8102-38639c84c763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:17.937238 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ef87ad44-d5c0-4776-8102-38639c84c763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:17.943618 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef87ad44-d5c0-4776-8102-38639c84c763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:17.944329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef87ad44-d5c0-4776-8102-38639c84c763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:17.944941 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef87ad44-d5c0-4776-8102-38639c84c763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:17.945656 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef87ad44-d5c0-4776-8102-38639c84c763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:17.946105 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef87ad44-d5c0-4776-8102-38639c84c763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:17.946517 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef87ad44-d5c0-4776-8102-38639c84c763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:18.093244 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ef87ad44-d5c0-4776-8102-38639c84c763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:18.105068 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ef87ad44-d5c0-4776-8102-38639c84c763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.172120 Aug 12 06:49:18.105875 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 96/193] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:17 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:19.129019 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b223adda-0cbe-41f4-8487-4d76de868073 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:19.129780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b223adda-0cbe-41f4-8487-4d76de868073 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:19.136560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b223adda-0cbe-41f4-8487-4d76de868073 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:19.137039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b223adda-0cbe-41f4-8487-4d76de868073 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:19.137469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b223adda-0cbe-41f4-8487-4d76de868073 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:19.138181 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b223adda-0cbe-41f4-8487-4d76de868073 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:19.138592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b223adda-0cbe-41f4-8487-4d76de868073 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:19.139041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b223adda-0cbe-41f4-8487-4d76de868073 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:19.279122 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b223adda-0cbe-41f4-8487-4d76de868073 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:19.287534 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b223adda-0cbe-41f4-8487-4d76de868073 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.164578 Aug 12 06:49:19.288103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 98/194] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:19 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:20.312358 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8b9fc1b5-f64c-4754-a653-0980db9bdada tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:20.313004 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8b9fc1b5-f64c-4754-a653-0980db9bdada tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:20.319844 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b9fc1b5-f64c-4754-a653-0980db9bdada tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:20.320306 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b9fc1b5-f64c-4754-a653-0980db9bdada tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:20.320740 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b9fc1b5-f64c-4754-a653-0980db9bdada tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:20.321427 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b9fc1b5-f64c-4754-a653-0980db9bdada tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:20.321864 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b9fc1b5-f64c-4754-a653-0980db9bdada tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:20.322268 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b9fc1b5-f64c-4754-a653-0980db9bdada tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:20.463963 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8b9fc1b5-f64c-4754-a653-0980db9bdada tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:20.471587 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8b9fc1b5-f64c-4754-a653-0980db9bdada tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.163277 Aug 12 06:49:20.472161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 97/195] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:20 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:21.496581 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8f562f41-10fa-42ef-bdff-3e0facf299d7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:21.497151 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8f562f41-10fa-42ef-bdff-3e0facf299d7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:21.504281 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f562f41-10fa-42ef-bdff-3e0facf299d7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:21.505200 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f562f41-10fa-42ef-bdff-3e0facf299d7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:21.505689 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f562f41-10fa-42ef-bdff-3e0facf299d7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:21.506458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f562f41-10fa-42ef-bdff-3e0facf299d7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:21.506960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f562f41-10fa-42ef-bdff-3e0facf299d7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:21.507487 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f562f41-10fa-42ef-bdff-3e0facf299d7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:21.646822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f562f41-10fa-42ef-bdff-3e0facf299d7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:21.654370 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8f562f41-10fa-42ef-bdff-3e0facf299d7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.163442 Aug 12 06:49:21.654934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 99/196] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:21 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:22.675262 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-60a30aef-e525-4b00-80a7-31bfb8b18993 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:22.675869 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-60a30aef-e525-4b00-80a7-31bfb8b18993 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:22.678481 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=43 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:49:22.684361 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a30aef-e525-4b00-80a7-31bfb8b18993 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:22.684841 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a30aef-e525-4b00-80a7-31bfb8b18993 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:22.685244 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a30aef-e525-4b00-80a7-31bfb8b18993 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:22.685962 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a30aef-e525-4b00-80a7-31bfb8b18993 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:22.686439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a30aef-e525-4b00-80a7-31bfb8b18993 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:22.686857 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a30aef-e525-4b00-80a7-31bfb8b18993 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:22.823372 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-60a30aef-e525-4b00-80a7-31bfb8b18993 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:22.831223 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-60a30aef-e525-4b00-80a7-31bfb8b18993 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.159857 Aug 12 06:49:22.831788 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 98/197] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:22 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:23.856487 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2e1457ea-4fe4-4b78-9f3d-745216b2f26a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:23.857531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2e1457ea-4fe4-4b78-9f3d-745216b2f26a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:23.868931 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e1457ea-4fe4-4b78-9f3d-745216b2f26a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:23.869592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e1457ea-4fe4-4b78-9f3d-745216b2f26a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:23.872759 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e1457ea-4fe4-4b78-9f3d-745216b2f26a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:23.873509 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e1457ea-4fe4-4b78-9f3d-745216b2f26a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:23.874282 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e1457ea-4fe4-4b78-9f3d-745216b2f26a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:23.874807 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e1457ea-4fe4-4b78-9f3d-745216b2f26a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:24.012244 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2e1457ea-4fe4-4b78-9f3d-745216b2f26a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:24.019937 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2e1457ea-4fe4-4b78-9f3d-745216b2f26a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.169198 Aug 12 06:49:24.020479 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 100/198] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:23 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:25.046239 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8ce6658b-323d-4c03-8aa5-3703ee943138 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:25.046896 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8ce6658b-323d-4c03-8aa5-3703ee943138 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:25.055640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ce6658b-323d-4c03-8aa5-3703ee943138 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:25.056233 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ce6658b-323d-4c03-8aa5-3703ee943138 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:25.056772 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ce6658b-323d-4c03-8aa5-3703ee943138 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:25.057653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ce6658b-323d-4c03-8aa5-3703ee943138 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:25.058093 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ce6658b-323d-4c03-8aa5-3703ee943138 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:25.058498 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ce6658b-323d-4c03-8aa5-3703ee943138 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:25.204039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8ce6658b-323d-4c03-8aa5-3703ee943138 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:25.211778 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8ce6658b-323d-4c03-8aa5-3703ee943138 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.170312 Aug 12 06:49:25.212358 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 99/199] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:25 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:26.232850 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7e96dbf0-56e7-40f0-bd4e-6d0fa9a54030 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:26.234179 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7e96dbf0-56e7-40f0-bd4e-6d0fa9a54030 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:26.240490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e96dbf0-56e7-40f0-bd4e-6d0fa9a54030 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:26.240971 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e96dbf0-56e7-40f0-bd4e-6d0fa9a54030 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:26.241391 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e96dbf0-56e7-40f0-bd4e-6d0fa9a54030 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:26.242081 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e96dbf0-56e7-40f0-bd4e-6d0fa9a54030 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:26.242558 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e96dbf0-56e7-40f0-bd4e-6d0fa9a54030 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:26.243122 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e96dbf0-56e7-40f0-bd4e-6d0fa9a54030 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:26.374248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7e96dbf0-56e7-40f0-bd4e-6d0fa9a54030 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:26.381833 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7e96dbf0-56e7-40f0-bd4e-6d0fa9a54030 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.152854 Aug 12 06:49:26.382399 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 101/200] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:26 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:27.405115 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7e736323-0f9b-45a5-946b-06131fadfe0f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:27.405772 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7e736323-0f9b-45a5-946b-06131fadfe0f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:27.412946 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e736323-0f9b-45a5-946b-06131fadfe0f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:27.413460 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e736323-0f9b-45a5-946b-06131fadfe0f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:27.413866 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e736323-0f9b-45a5-946b-06131fadfe0f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:27.414568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e736323-0f9b-45a5-946b-06131fadfe0f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:27.415008 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e736323-0f9b-45a5-946b-06131fadfe0f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:27.415423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e736323-0f9b-45a5-946b-06131fadfe0f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:27.565450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7e736323-0f9b-45a5-946b-06131fadfe0f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:27.576071 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7e736323-0f9b-45a5-946b-06131fadfe0f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.175069 Aug 12 06:49:27.579113 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 100/201] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:27 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:28.597702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-31fa1bda-411c-41fa-9c58-79b0925e9f64 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:28.598387 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-31fa1bda-411c-41fa-9c58-79b0925e9f64 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:28.604781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31fa1bda-411c-41fa-9c58-79b0925e9f64 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:28.605277 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31fa1bda-411c-41fa-9c58-79b0925e9f64 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:28.605710 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31fa1bda-411c-41fa-9c58-79b0925e9f64 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:28.606394 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31fa1bda-411c-41fa-9c58-79b0925e9f64 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:28.606835 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31fa1bda-411c-41fa-9c58-79b0925e9f64 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:28.607257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31fa1bda-411c-41fa-9c58-79b0925e9f64 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:28.742469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-31fa1bda-411c-41fa-9c58-79b0925e9f64 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:28.752062 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-31fa1bda-411c-41fa-9c58-79b0925e9f64 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.158284 Aug 12 06:49:28.752740 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 102/202] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:28 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:29.773584 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0c74101c-83d1-41f7-b475-6f15fd88efbb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:29.774159 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0c74101c-83d1-41f7-b475-6f15fd88efbb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:29.781034 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0c74101c-83d1-41f7-b475-6f15fd88efbb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:29.781510 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0c74101c-83d1-41f7-b475-6f15fd88efbb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:29.781936 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0c74101c-83d1-41f7-b475-6f15fd88efbb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:29.782614 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0c74101c-83d1-41f7-b475-6f15fd88efbb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:29.783089 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0c74101c-83d1-41f7-b475-6f15fd88efbb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:29.783501 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0c74101c-83d1-41f7-b475-6f15fd88efbb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:29.801986 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:49:29.915560 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0c74101c-83d1-41f7-b475-6f15fd88efbb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:29.923522 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0c74101c-83d1-41f7-b475-6f15fd88efbb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1521 microversion: 2.1 time: 0.154179 Aug 12 06:49:29.924069 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 101/203] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:29 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:30.948422 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8dc4acf8-4650-4bdd-8a88-53c437f27828 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:30.949546 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8dc4acf8-4650-4bdd-8a88-53c437f27828 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:30.959109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dc4acf8-4650-4bdd-8a88-53c437f27828 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:30.959891 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dc4acf8-4650-4bdd-8a88-53c437f27828 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:30.960587 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dc4acf8-4650-4bdd-8a88-53c437f27828 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:30.961698 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dc4acf8-4650-4bdd-8a88-53c437f27828 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:30.962429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dc4acf8-4650-4bdd-8a88-53c437f27828 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:30.963249 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dc4acf8-4650-4bdd-8a88-53c437f27828 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:31.103484 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8dc4acf8-4650-4bdd-8a88-53c437f27828 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:31.111594 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8dc4acf8-4650-4bdd-8a88-53c437f27828 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1501 microversion: 2.1 time: 0.169694 Aug 12 06:49:31.112113 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 103/204] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:30 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:31.131716 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ac25d041-9bde-48c5-a3b6-e92e44b5c3a0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:31.132333 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ac25d041-9bde-48c5-a3b6-e92e44b5c3a0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:31.138792 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac25d041-9bde-48c5-a3b6-e92e44b5c3a0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:31.139289 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac25d041-9bde-48c5-a3b6-e92e44b5c3a0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:31.139717 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac25d041-9bde-48c5-a3b6-e92e44b5c3a0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:31.140394 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac25d041-9bde-48c5-a3b6-e92e44b5c3a0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:31.140874 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac25d041-9bde-48c5-a3b6-e92e44b5c3a0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:31.141485 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac25d041-9bde-48c5-a3b6-e92e44b5c3a0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:31.477930 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ac25d041-9bde-48c5-a3b6-e92e44b5c3a0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:31.486149 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ac25d041-9bde-48c5-a3b6-e92e44b5c3a0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1515 microversion: 2.1 time: 0.358512 Aug 12 06:49:31.486716 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 102/205] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:31 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1515 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:32.889389 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-591c1b3a-0913-46a0-a596-7aa7358bc1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:49:32.891587 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-591c1b3a-0913-46a0-a596-7aa7358bc1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:32.897729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-591c1b3a-0913-46a0-a596-7aa7358bc1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:32.898227 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-591c1b3a-0913-46a0-a596-7aa7358bc1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:32.898655 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-591c1b3a-0913-46a0-a596-7aa7358bc1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:32.899464 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-591c1b3a-0913-46a0-a596-7aa7358bc1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:32.899955 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-591c1b3a-0913-46a0-a596-7aa7358bc1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:32.900399 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-591c1b3a-0913-46a0-a596-7aa7358bc1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:32.923958 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-591c1b3a-0913-46a0-a596-7aa7358bc1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lazy-loading 'flavor' on Instance uuid 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:49:33.051188 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-591c1b3a-0913-46a0-a596-7aa7358bc1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "POST /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e/action" status: 200 len: 32 microversion: 2.1 time: 0.165597 Aug 12 06:49:33.051968 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 104/206] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:49:32 2022] POST /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 06:49:33.069321 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b6b3c5f1-e98b-4023-8c5d-83a523b47e15 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:33.070301 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b6b3c5f1-e98b-4023-8c5d-83a523b47e15 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:33.081332 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6b3c5f1-e98b-4023-8c5d-83a523b47e15 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:33.082697 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6b3c5f1-e98b-4023-8c5d-83a523b47e15 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:33.083607 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6b3c5f1-e98b-4023-8c5d-83a523b47e15 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:33.084911 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6b3c5f1-e98b-4023-8c5d-83a523b47e15 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:33.085799 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6b3c5f1-e98b-4023-8c5d-83a523b47e15 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:33.086641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6b3c5f1-e98b-4023-8c5d-83a523b47e15 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:33.246862 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b6b3c5f1-e98b-4023-8c5d-83a523b47e15 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:33.254725 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b6b3c5f1-e98b-4023-8c5d-83a523b47e15 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.190744 Aug 12 06:49:33.255328 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 103/207] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:33 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:49:34.276528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2dd6ca3a-7d47-41af-84f1-ef998a90c72c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:34.277208 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2dd6ca3a-7d47-41af-84f1-ef998a90c72c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:34.283786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dd6ca3a-7d47-41af-84f1-ef998a90c72c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:34.284262 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dd6ca3a-7d47-41af-84f1-ef998a90c72c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:34.284681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dd6ca3a-7d47-41af-84f1-ef998a90c72c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:34.285365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dd6ca3a-7d47-41af-84f1-ef998a90c72c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:34.285809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dd6ca3a-7d47-41af-84f1-ef998a90c72c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:34.286225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dd6ca3a-7d47-41af-84f1-ef998a90c72c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:34.421911 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2dd6ca3a-7d47-41af-84f1-ef998a90c72c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:34.429454 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2dd6ca3a-7d47-41af-84f1-ef998a90c72c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.157266 Aug 12 06:49:34.430023 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 105/208] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:34 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:35.451035 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f90a8df7-7f00-4146-933c-b1a16133d9c2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:35.451586 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f90a8df7-7f00-4146-933c-b1a16133d9c2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:35.460744 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90a8df7-7f00-4146-933c-b1a16133d9c2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:35.461365 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90a8df7-7f00-4146-933c-b1a16133d9c2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:35.461954 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90a8df7-7f00-4146-933c-b1a16133d9c2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:35.462963 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90a8df7-7f00-4146-933c-b1a16133d9c2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:35.463522 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90a8df7-7f00-4146-933c-b1a16133d9c2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:35.463944 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90a8df7-7f00-4146-933c-b1a16133d9c2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:35.660812 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f90a8df7-7f00-4146-933c-b1a16133d9c2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:35.668780 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f90a8df7-7f00-4146-933c-b1a16133d9c2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.221731 Aug 12 06:49:35.669545 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 104/209] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:35 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:36.690036 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6eb72530-802e-4f5e-a625-9fdb24abe37c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:36.690600 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6eb72530-802e-4f5e-a625-9fdb24abe37c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:36.697233 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb72530-802e-4f5e-a625-9fdb24abe37c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:36.697713 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb72530-802e-4f5e-a625-9fdb24abe37c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:36.698548 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb72530-802e-4f5e-a625-9fdb24abe37c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:36.699741 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb72530-802e-4f5e-a625-9fdb24abe37c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:36.700546 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb72530-802e-4f5e-a625-9fdb24abe37c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:36.701312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6eb72530-802e-4f5e-a625-9fdb24abe37c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:36.859836 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6eb72530-802e-4f5e-a625-9fdb24abe37c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:36.870646 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6eb72530-802e-4f5e-a625-9fdb24abe37c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.184321 Aug 12 06:49:36.871498 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 106/210] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:36 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:37.899565 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3120f62a-35c6-4ee1-80d1-c1a9515d7779 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:37.900287 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3120f62a-35c6-4ee1-80d1-c1a9515d7779 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:37.907511 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3120f62a-35c6-4ee1-80d1-c1a9515d7779 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:37.907986 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3120f62a-35c6-4ee1-80d1-c1a9515d7779 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:37.908414 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3120f62a-35c6-4ee1-80d1-c1a9515d7779 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:37.909097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3120f62a-35c6-4ee1-80d1-c1a9515d7779 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:37.909543 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3120f62a-35c6-4ee1-80d1-c1a9515d7779 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:37.909957 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3120f62a-35c6-4ee1-80d1-c1a9515d7779 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:38.042995 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3120f62a-35c6-4ee1-80d1-c1a9515d7779 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:38.050871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3120f62a-35c6-4ee1-80d1-c1a9515d7779 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.157033 Aug 12 06:49:38.051489 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 105/211] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:37 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:39.071791 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6f746b8a-feca-4407-8b4a-9970c2eed2c1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:39.072487 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6f746b8a-feca-4407-8b4a-9970c2eed2c1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:39.078915 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f746b8a-feca-4407-8b4a-9970c2eed2c1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:39.079508 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f746b8a-feca-4407-8b4a-9970c2eed2c1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:39.079936 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f746b8a-feca-4407-8b4a-9970c2eed2c1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:39.080634 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f746b8a-feca-4407-8b4a-9970c2eed2c1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:39.081160 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f746b8a-feca-4407-8b4a-9970c2eed2c1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:39.081578 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f746b8a-feca-4407-8b4a-9970c2eed2c1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:39.216086 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f746b8a-feca-4407-8b4a-9970c2eed2c1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:39.224291 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6f746b8a-feca-4407-8b4a-9970c2eed2c1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.156479 Aug 12 06:49:39.224877 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 107/212] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:39 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:40.250193 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-22fd2978-e36b-41f8-8830-2df89626d10e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:40.250766 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-22fd2978-e36b-41f8-8830-2df89626d10e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:40.257056 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22fd2978-e36b-41f8-8830-2df89626d10e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:40.257534 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22fd2978-e36b-41f8-8830-2df89626d10e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:40.257965 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22fd2978-e36b-41f8-8830-2df89626d10e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:40.258636 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22fd2978-e36b-41f8-8830-2df89626d10e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:40.259128 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22fd2978-e36b-41f8-8830-2df89626d10e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:40.259544 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22fd2978-e36b-41f8-8830-2df89626d10e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:40.394415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-22fd2978-e36b-41f8-8830-2df89626d10e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:40.404330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-22fd2978-e36b-41f8-8830-2df89626d10e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.160179 Aug 12 06:49:40.404909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 106/213] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:40 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:49:41.427915 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1b1cb50f-5de7-4ee5-b4b6-a1a636b6e520 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:41.428574 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1b1cb50f-5de7-4ee5-b4b6-a1a636b6e520 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:41.434871 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b1cb50f-5de7-4ee5-b4b6-a1a636b6e520 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:41.435515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b1cb50f-5de7-4ee5-b4b6-a1a636b6e520 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:41.435928 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b1cb50f-5de7-4ee5-b4b6-a1a636b6e520 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:41.436614 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b1cb50f-5de7-4ee5-b4b6-a1a636b6e520 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:41.437232 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b1cb50f-5de7-4ee5-b4b6-a1a636b6e520 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:41.437804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b1cb50f-5de7-4ee5-b4b6-a1a636b6e520 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:41.614921 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1b1cb50f-5de7-4ee5-b4b6-a1a636b6e520 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:41.622818 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1b1cb50f-5de7-4ee5-b4b6-a1a636b6e520 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.199093 Aug 12 06:49:41.623458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 108/214] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:41 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:42.644243 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e919e2e1-69a6-4e33-94b8-6f16d3b93ca8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:42.644822 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e919e2e1-69a6-4e33-94b8-6f16d3b93ca8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:42.652675 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e919e2e1-69a6-4e33-94b8-6f16d3b93ca8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:42.653150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e919e2e1-69a6-4e33-94b8-6f16d3b93ca8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:42.653571 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e919e2e1-69a6-4e33-94b8-6f16d3b93ca8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:42.654329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e919e2e1-69a6-4e33-94b8-6f16d3b93ca8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:42.655050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e919e2e1-69a6-4e33-94b8-6f16d3b93ca8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:42.655471 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e919e2e1-69a6-4e33-94b8-6f16d3b93ca8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:42.803966 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e919e2e1-69a6-4e33-94b8-6f16d3b93ca8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:42.811897 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e919e2e1-69a6-4e33-94b8-6f16d3b93ca8 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.171992 Aug 12 06:49:42.812450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 107/215] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:42 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:43.833181 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c15251b2-a50f-44ac-afa9-88acf897e763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:43.835395 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c15251b2-a50f-44ac-afa9-88acf897e763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:43.837526 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=30 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:49:43.842762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c15251b2-a50f-44ac-afa9-88acf897e763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:43.843322 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c15251b2-a50f-44ac-afa9-88acf897e763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:43.843745 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c15251b2-a50f-44ac-afa9-88acf897e763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:43.844428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c15251b2-a50f-44ac-afa9-88acf897e763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:43.844902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c15251b2-a50f-44ac-afa9-88acf897e763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:43.845316 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c15251b2-a50f-44ac-afa9-88acf897e763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:43.978436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c15251b2-a50f-44ac-afa9-88acf897e763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:43.986552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c15251b2-a50f-44ac-afa9-88acf897e763 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.157404 Aug 12 06:49:43.987145 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 109/216] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:43 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:45.011586 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d7f1e83e-070a-4de2-98cf-e3596eb647ba tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:45.012250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d7f1e83e-070a-4de2-98cf-e3596eb647ba tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:45.019817 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7f1e83e-070a-4de2-98cf-e3596eb647ba tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:45.020348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7f1e83e-070a-4de2-98cf-e3596eb647ba tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:45.020814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7f1e83e-070a-4de2-98cf-e3596eb647ba tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:45.021876 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7f1e83e-070a-4de2-98cf-e3596eb647ba tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:45.022382 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7f1e83e-070a-4de2-98cf-e3596eb647ba tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:45.022829 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7f1e83e-070a-4de2-98cf-e3596eb647ba tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:45.156693 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d7f1e83e-070a-4de2-98cf-e3596eb647ba tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:45.164983 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d7f1e83e-070a-4de2-98cf-e3596eb647ba tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.159602 Aug 12 06:49:45.165545 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 108/217] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:45 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:46.186614 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5d0d253c-c260-4b81-a582-8f0bd87b49c7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:46.187171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5d0d253c-c260-4b81-a582-8f0bd87b49c7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:46.193562 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0d253c-c260-4b81-a582-8f0bd87b49c7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:46.194039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0d253c-c260-4b81-a582-8f0bd87b49c7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:46.194457 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0d253c-c260-4b81-a582-8f0bd87b49c7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:46.195167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0d253c-c260-4b81-a582-8f0bd87b49c7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:46.195609 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0d253c-c260-4b81-a582-8f0bd87b49c7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:46.196024 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0d253c-c260-4b81-a582-8f0bd87b49c7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:46.198551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:49:46.343486 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5d0d253c-c260-4b81-a582-8f0bd87b49c7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:46.351461 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5d0d253c-c260-4b81-a582-8f0bd87b49c7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.169212 Aug 12 06:49:46.352030 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 110/218] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:46 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:47.261187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6ca4de4b-b3c3-4824-9659-8d6cbcbf71ae tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:47.261844 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6ca4de4b-b3c3-4824-9659-8d6cbcbf71ae tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:47.270525 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca4de4b-b3c3-4824-9659-8d6cbcbf71ae tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:47.271613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca4de4b-b3c3-4824-9659-8d6cbcbf71ae tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:47.272274 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca4de4b-b3c3-4824-9659-8d6cbcbf71ae tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:47.273337 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca4de4b-b3c3-4824-9659-8d6cbcbf71ae tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:47.273956 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca4de4b-b3c3-4824-9659-8d6cbcbf71ae tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:47.274625 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca4de4b-b3c3-4824-9659-8d6cbcbf71ae tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:47.303612 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6ca4de4b-b3c3-4824-9659-8d6cbcbf71ae tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/ips" status: 200 len: 150 microversion: 2.1 time: 0.047094 Aug 12 06:49:47.304174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 109/219] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 06:49:47 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:49:47.373778 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c6a15a2f-2498-49e6-9ead-16679621241f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:47.374301 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c6a15a2f-2498-49e6-9ead-16679621241f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:47.380257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6a15a2f-2498-49e6-9ead-16679621241f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:47.380723 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6a15a2f-2498-49e6-9ead-16679621241f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:47.381144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6a15a2f-2498-49e6-9ead-16679621241f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:47.381814 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6a15a2f-2498-49e6-9ead-16679621241f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:47.382256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6a15a2f-2498-49e6-9ead-16679621241f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:47.382664 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6a15a2f-2498-49e6-9ead-16679621241f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:47.510775 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c6a15a2f-2498-49e6-9ead-16679621241f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:47.520131 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c6a15a2f-2498-49e6-9ead-16679621241f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.150632 Aug 12 06:49:47.520943 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 111/220] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:47 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:47.540923 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ebd8a098-e1ed-451f-9225-388baece4ea7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:47.541443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ebd8a098-e1ed-451f-9225-388baece4ea7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:47.551285 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebd8a098-e1ed-451f-9225-388baece4ea7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:47.551764 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebd8a098-e1ed-451f-9225-388baece4ea7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:47.552395 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebd8a098-e1ed-451f-9225-388baece4ea7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:47.553053 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebd8a098-e1ed-451f-9225-388baece4ea7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:47.553497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebd8a098-e1ed-451f-9225-388baece4ea7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:47.553907 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebd8a098-e1ed-451f-9225-388baece4ea7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:47.585397 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ebd8a098-e1ed-451f-9225-388baece4ea7 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/ips" status: 200 len: 152 microversion: 2.20 time: 0.048139 Aug 12 06:49:47.592201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 110/221] 10.222.0.20 () {60 vars in 1289 bytes} [Fri Aug 12 06:49:47 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:49:48.543894 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a25373fa-bbdf-413e-afca-3b42b2f418de tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:48.544881 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a25373fa-bbdf-413e-afca-3b42b2f418de tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:48.551876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25373fa-bbdf-413e-afca-3b42b2f418de tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:48.552678 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25373fa-bbdf-413e-afca-3b42b2f418de tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:48.553208 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25373fa-bbdf-413e-afca-3b42b2f418de tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:48.553945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25373fa-bbdf-413e-afca-3b42b2f418de tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:48.554542 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25373fa-bbdf-413e-afca-3b42b2f418de tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:48.554962 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25373fa-bbdf-413e-afca-3b42b2f418de tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:48.705911 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a25373fa-bbdf-413e-afca-3b42b2f418de tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:48.713406 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a25373fa-bbdf-413e-afca-3b42b2f418de tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.175112 Aug 12 06:49:48.713977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 112/222] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:48 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:48.993052 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c1f179f4-ff1e-434e-ba6c-f3480fcbca4b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:48.993552 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c1f179f4-ff1e-434e-ba6c-f3480fcbca4b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:49.000287 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c1f179f4-ff1e-434e-ba6c-f3480fcbca4b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:49.000776 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c1f179f4-ff1e-434e-ba6c-f3480fcbca4b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:49.001207 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c1f179f4-ff1e-434e-ba6c-f3480fcbca4b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:49.001896 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c1f179f4-ff1e-434e-ba6c-f3480fcbca4b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:49.002347 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c1f179f4-ff1e-434e-ba6c-f3480fcbca4b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:49.002736 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c1f179f4-ff1e-434e-ba6c-f3480fcbca4b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:49.026320 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c1f179f4-ff1e-434e-ba6c-f3480fcbca4b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/ips" status: 200 len: 145 microversion: 2.1 time: 0.037214 Aug 12 06:49:49.026887 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 111/223] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 06:49:48 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:49:49.734028 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-828d6273-17ea-4aa9-9705-81b47d24e14a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:49.734787 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-828d6273-17ea-4aa9-9705-81b47d24e14a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:49.740996 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d6273-17ea-4aa9-9705-81b47d24e14a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:49.741477 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d6273-17ea-4aa9-9705-81b47d24e14a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:49.741932 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d6273-17ea-4aa9-9705-81b47d24e14a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:49.742752 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d6273-17ea-4aa9-9705-81b47d24e14a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:49.743234 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d6273-17ea-4aa9-9705-81b47d24e14a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:49.743668 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d6273-17ea-4aa9-9705-81b47d24e14a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:49.882669 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-828d6273-17ea-4aa9-9705-81b47d24e14a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:49.890544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-828d6273-17ea-4aa9-9705-81b47d24e14a tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.160383 Aug 12 06:49:49.891121 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 113/224] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:49 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:50.913520 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d30bab95-aad0-40f8-9826-de0ee0381e65 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:50.914303 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d30bab95-aad0-40f8-9826-de0ee0381e65 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:50.922490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30bab95-aad0-40f8-9826-de0ee0381e65 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:50.922964 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30bab95-aad0-40f8-9826-de0ee0381e65 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:50.923704 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30bab95-aad0-40f8-9826-de0ee0381e65 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:50.924925 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30bab95-aad0-40f8-9826-de0ee0381e65 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:50.925359 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30bab95-aad0-40f8-9826-de0ee0381e65 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:50.925774 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30bab95-aad0-40f8-9826-de0ee0381e65 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:51.066388 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d30bab95-aad0-40f8-9826-de0ee0381e65 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:51.074166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d30bab95-aad0-40f8-9826-de0ee0381e65 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.165824 Aug 12 06:49:51.074756 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 112/225] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:50 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:52.095484 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-25179992-f521-4fef-8b3a-5ce6f77beb48 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:52.096098 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-25179992-f521-4fef-8b3a-5ce6f77beb48 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:52.102385 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25179992-f521-4fef-8b3a-5ce6f77beb48 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:52.102868 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25179992-f521-4fef-8b3a-5ce6f77beb48 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:52.103395 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25179992-f521-4fef-8b3a-5ce6f77beb48 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:52.104090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25179992-f521-4fef-8b3a-5ce6f77beb48 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:52.104541 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25179992-f521-4fef-8b3a-5ce6f77beb48 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:52.104960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25179992-f521-4fef-8b3a-5ce6f77beb48 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:52.241609 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-25179992-f521-4fef-8b3a-5ce6f77beb48 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:52.249519 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-25179992-f521-4fef-8b3a-5ce6f77beb48 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.157829 Aug 12 06:49:52.250102 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 114/226] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:52 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:52.944371 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7bbc16fb-4cdd-4d44-b418-a615f271ec6d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0af5da2-2ca2-4d79-8313-4956f687f2cc"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:49:52.946828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7bbc16fb-4cdd-4d44-b418-a615f271ec6d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:52.949208 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=30 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:49:52.954417 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bbc16fb-4cdd-4d44-b418-a615f271ec6d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:52.954886 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bbc16fb-4cdd-4d44-b418-a615f271ec6d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:52.955333 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bbc16fb-4cdd-4d44-b418-a615f271ec6d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:52.956007 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bbc16fb-4cdd-4d44-b418-a615f271ec6d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:52.956449 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bbc16fb-4cdd-4d44-b418-a615f271ec6d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:52.956826 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bbc16fb-4cdd-4d44-b418-a615f271ec6d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:53.270536 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-00782701-9aa6-4d74-8fe4-7de7656a4400 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:53.271537 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-00782701-9aa6-4d74-8fe4-7de7656a4400 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:53.272206 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7bbc16fb-4cdd-4d44-b418-a615f271ec6d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330909 Aug 12 06:49:53.273213 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 113/227] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:49:52 2022] POST /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:49:53.278155 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00782701-9aa6-4d74-8fe4-7de7656a4400 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:53.278605 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00782701-9aa6-4d74-8fe4-7de7656a4400 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:53.279262 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00782701-9aa6-4d74-8fe4-7de7656a4400 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:53.280331 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00782701-9aa6-4d74-8fe4-7de7656a4400 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:53.280934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00782701-9aa6-4d74-8fe4-7de7656a4400 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:53.281514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00782701-9aa6-4d74-8fe4-7de7656a4400 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:53.411451 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-00782701-9aa6-4d74-8fe4-7de7656a4400 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:53.419450 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-00782701-9aa6-4d74-8fe4-7de7656a4400 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.152915 Aug 12 06:49:53.420094 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 115/228] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:53 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:49:54.036718 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a7f3d056-38e6-410c-8933-1151240db5d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:49:54.037588 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a7f3d056-38e6-410c-8933-1151240db5d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:54.046004 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7f3d056-38e6-410c-8933-1151240db5d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:54.046476 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7f3d056-38e6-410c-8933-1151240db5d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:54.046892 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7f3d056-38e6-410c-8933-1151240db5d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:54.047601 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7f3d056-38e6-410c-8933-1151240db5d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:54.048044 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7f3d056-38e6-410c-8933-1151240db5d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:54.048453 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7f3d056-38e6-410c-8933-1151240db5d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:54.212195 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-a7f3d056-38e6-410c-8933-1151240db5d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lazy-loading 'flavor' on Instance uuid a6bc12e0-d758-47a7-920d-971a6e993711 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:49:54.425742 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a7f3d056-38e6-410c-8933-1151240db5d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "POST /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/action" status: 202 len: 0 microversion: 2.20 time: 0.395449 Aug 12 06:49:54.426598 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 114/229] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Aug 12 06:49:54 2022] POST /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:49:54.435119 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:54.436327 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:54.440250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ebc166e8-ea19-4409-9064-78769516e468 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:54.440991 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ebc166e8-ea19-4409-9064-78769516e468 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:54.442507 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:54.443202 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:54.443618 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:54.444720 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:54.445167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:54.445583 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:54.447998 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebc166e8-ea19-4409-9064-78769516e468 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:54.448354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebc166e8-ea19-4409-9064-78769516e468 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:54.448800 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebc166e8-ea19-4409-9064-78769516e468 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:54.450835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebc166e8-ea19-4409-9064-78769516e468 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:54.450835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebc166e8-ea19-4409-9064-78769516e468 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:54.451076 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebc166e8-ea19-4409-9064-78769516e468 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:54.645709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:54.653082 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ebc166e8-ea19-4409-9064-78769516e468 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:54.654653 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:54.656244 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:54.656451 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:49:54.657461 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2c385c05-fa2f-4ff0-a99c-717451b14d10 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.226588 Aug 12 06:49:54.658082 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 116/230] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:49:54 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:49:54.661190 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ebc166e8-ea19-4409-9064-78769516e468 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.224895 Aug 12 06:49:54.661738 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 115/231] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:54 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:49:55.683970 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:55.684487 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8f18ea7c-fc4a-479b-83c0-52ba15c51a4b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:55.684851 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:55.684945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8f18ea7c-fc4a-479b-83c0-52ba15c51a4b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:55.691117 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:55.691598 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:55.692020 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:55.692165 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f18ea7c-fc4a-479b-83c0-52ba15c51a4b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:55.692593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f18ea7c-fc4a-479b-83c0-52ba15c51a4b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:55.692752 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:55.693016 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f18ea7c-fc4a-479b-83c0-52ba15c51a4b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:55.693168 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:55.693510 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:55.693651 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f18ea7c-fc4a-479b-83c0-52ba15c51a4b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:55.694099 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f18ea7c-fc4a-479b-83c0-52ba15c51a4b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:55.694508 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f18ea7c-fc4a-479b-83c0-52ba15c51a4b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:55.886720 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:55.888670 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8f18ea7c-fc4a-479b-83c0-52ba15c51a4b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:55.894059 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:55.895587 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:55.896527 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8f18ea7c-fc4a-479b-83c0-52ba15c51a4b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.217119 Aug 12 06:49:55.897133 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 116/232] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:55 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:55.897285 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7c789902-9229-4da8-8baf-489384d7a28e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.219138 Aug 12 06:49:55.897777 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 117/233] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:49:55 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:49:56.917354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-983e46fa-a43f-402a-81fa-37d03458cfc4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:56.917961 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-983e46fa-a43f-402a-81fa-37d03458cfc4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:56.924154 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:56.924154 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:56.929705 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-983e46fa-a43f-402a-81fa-37d03458cfc4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:56.930190 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-983e46fa-a43f-402a-81fa-37d03458cfc4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:56.930801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-983e46fa-a43f-402a-81fa-37d03458cfc4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:56.932037 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-983e46fa-a43f-402a-81fa-37d03458cfc4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:56.932790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-983e46fa-a43f-402a-81fa-37d03458cfc4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:56.932910 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:56.933470 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-983e46fa-a43f-402a-81fa-37d03458cfc4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:56.933588 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:56.934120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:56.934900 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:56.935713 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:56.936707 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:57.143968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-983e46fa-a43f-402a-81fa-37d03458cfc4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:57.147211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:57.152044 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-983e46fa-a43f-402a-81fa-37d03458cfc4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.238547 Aug 12 06:49:57.152934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 117/234] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:56 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:57.160293 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:57.161810 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:57.162993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eac1153b-aa56-464d-8f45-e3f2938ab6bb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.245365 Aug 12 06:49:57.163541 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 118/235] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:49:56 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:49:58.014999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ac6266f7-fb25-40b9-b2eb-2a012a93b523 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ec80d7a-dfba-4b8d-a56c-dad44adb19d1"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:49:58.017321 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ac6266f7-fb25-40b9-b2eb-2a012a93b523 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:58.024349 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac6266f7-fb25-40b9-b2eb-2a012a93b523 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:58.024832 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac6266f7-fb25-40b9-b2eb-2a012a93b523 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:58.025262 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac6266f7-fb25-40b9-b2eb-2a012a93b523 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:58.026002 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac6266f7-fb25-40b9-b2eb-2a012a93b523 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:58.026452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac6266f7-fb25-40b9-b2eb-2a012a93b523 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:58.026870 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac6266f7-fb25-40b9-b2eb-2a012a93b523 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:58.175674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a0b22c35-2d29-4c4a-9844-5cdd842ce116 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:58.176271 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a0b22c35-2d29-4c4a-9844-5cdd842ce116 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:58.184000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0b22c35-2d29-4c4a-9844-5cdd842ce116 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:58.184478 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0b22c35-2d29-4c4a-9844-5cdd842ce116 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:58.184902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0b22c35-2d29-4c4a-9844-5cdd842ce116 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:58.185579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0b22c35-2d29-4c4a-9844-5cdd842ce116 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:58.186021 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0b22c35-2d29-4c4a-9844-5cdd842ce116 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:58.186462 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0b22c35-2d29-4c4a-9844-5cdd842ce116 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:58.320219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0b22c35-2d29-4c4a-9844-5cdd842ce116 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:58.328509 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a0b22c35-2d29-4c4a-9844-5cdd842ce116 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.156745 Aug 12 06:49:58.329075 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 119/236] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:58 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:58.333425 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:58.334008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:58.339746 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:58.340234 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:58.340654 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:58.341324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:58.341773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:58.342182 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:58.470130 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:58.478314 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:58.479913 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:58.481021 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b1207697-17b4-4419-96aa-e973ea995f76 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.151040 Aug 12 06:49:58.481573 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 120/237] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:49:58 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:49:59.353349 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e2dea4c5-d8a1-4851-a3b0-9e1ab4e1c9e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:59.354167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e2dea4c5-d8a1-4851-a3b0-9e1ab4e1c9e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:59.361171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2dea4c5-d8a1-4851-a3b0-9e1ab4e1c9e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:59.361714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2dea4c5-d8a1-4851-a3b0-9e1ab4e1c9e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:59.362184 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2dea4c5-d8a1-4851-a3b0-9e1ab4e1c9e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:59.362944 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2dea4c5-d8a1-4851-a3b0-9e1ab4e1c9e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:59.363488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2dea4c5-d8a1-4851-a3b0-9e1ab4e1c9e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:59.363956 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2dea4c5-d8a1-4851-a3b0-9e1ab4e1c9e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:59.496041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e2dea4c5-d8a1-4851-a3b0-9e1ab4e1c9e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:59.503748 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e2dea4c5-d8a1-4851-a3b0-9e1ab4e1c9e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.156891 Aug 12 06:49:59.515674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 121/238] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:49:59 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:49:59.515674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:49:59.515674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:49:59.515674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:59.516586 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:59.516586 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:59.516843 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:49:59.517286 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:49:59.517703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:49:59.656402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:59.669268 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:59.670894 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:49:59.672249 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a0683aa8-f97a-456a-a0ca-9551f1a8ebdf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.166845 Aug 12 06:49:59.672847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 122/239] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:49:59 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:00.527747 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7a4ce67f-533c-4c57-b808-d62d769c1085 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:00.528302 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7a4ce67f-533c-4c57-b808-d62d769c1085 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:00.534955 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a4ce67f-533c-4c57-b808-d62d769c1085 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:00.535462 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a4ce67f-533c-4c57-b808-d62d769c1085 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:00.535882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a4ce67f-533c-4c57-b808-d62d769c1085 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:00.536557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a4ce67f-533c-4c57-b808-d62d769c1085 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:00.537000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a4ce67f-533c-4c57-b808-d62d769c1085 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:00.537414 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a4ce67f-533c-4c57-b808-d62d769c1085 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:00.668743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a4ce67f-533c-4c57-b808-d62d769c1085 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:00.679887 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7a4ce67f-533c-4c57-b808-d62d769c1085 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.157063 Aug 12 06:50:00.680631 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 123/240] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:00 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:00.698670 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:00.699286 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:00.705008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:00.705467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:00.705884 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:00.706554 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:00.707026 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:00.707437 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:00.834469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:00.845404 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:00.847783 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:00.849525 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-97ba8e2d-f64b-4158-a4a9-9f0bd3824154 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.157178 Aug 12 06:50:00.850230 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 124/241] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:00 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:50:01.707498 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e401526e-3d7f-482d-98ad-800612222aef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:01.708074 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e401526e-3d7f-482d-98ad-800612222aef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:01.715494 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e401526e-3d7f-482d-98ad-800612222aef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:01.715979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e401526e-3d7f-482d-98ad-800612222aef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:01.716410 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e401526e-3d7f-482d-98ad-800612222aef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:01.717103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e401526e-3d7f-482d-98ad-800612222aef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:01.717553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e401526e-3d7f-482d-98ad-800612222aef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:01.717973 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e401526e-3d7f-482d-98ad-800612222aef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:01.858444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e401526e-3d7f-482d-98ad-800612222aef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:01.866011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e401526e-3d7f-482d-98ad-800612222aef tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.165019 Aug 12 06:50:01.866614 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 125/242] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:01 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:01.872424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:01.873007 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:01.878718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:01.879225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:01.879650 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:01.880334 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:01.880766 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:01.881177 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:02.008116 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:02.010312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:02.017367 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:02.018846 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:02.020028 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dbc07087-7166-4b33-a801-89cbc94671c3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.151183 Aug 12 06:50:02.020631 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 126/243] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:01 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:02.689122 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ac6266f7-fb25-40b9-b2eb-2a012a93b523 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "POST /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.678144 Aug 12 06:50:02.690020 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 118/244] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:49:58 2022] POST /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/os-volume_attachments => generated 194 bytes in 4680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:50:02.891010 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6dc4b40b-58eb-4d21-997b-3cbb709adfec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:02.891611 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6dc4b40b-58eb-4d21-997b-3cbb709adfec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:02.898138 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dc4b40b-58eb-4d21-997b-3cbb709adfec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:02.898619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dc4b40b-58eb-4d21-997b-3cbb709adfec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:02.899142 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dc4b40b-58eb-4d21-997b-3cbb709adfec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:02.899827 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dc4b40b-58eb-4d21-997b-3cbb709adfec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:02.900277 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dc4b40b-58eb-4d21-997b-3cbb709adfec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:02.900693 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dc4b40b-58eb-4d21-997b-3cbb709adfec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:03.031793 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6dc4b40b-58eb-4d21-997b-3cbb709adfec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:03.041551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6dc4b40b-58eb-4d21-997b-3cbb709adfec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.158516 Aug 12 06:50:03.042288 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 127/245] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:02 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:03.043954 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:03.044634 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:03.051424 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:03.051976 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:03.052466 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:03.053362 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:03.053784 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:03.054282 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:03.189858 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:03.197877 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:03.199400 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:03.200538 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-906b3fe2-25d0-48cb-b301-988d25e4b651 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.161086 Aug 12 06:50:03.201121 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 119/246] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:03 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:50:04.061750 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-372fb076-a884-4bdd-aa27-37f4a547781c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:04.062312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-372fb076-a884-4bdd-aa27-37f4a547781c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:04.069209 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372fb076-a884-4bdd-aa27-37f4a547781c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:04.069687 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372fb076-a884-4bdd-aa27-37f4a547781c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:04.070105 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372fb076-a884-4bdd-aa27-37f4a547781c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:04.070783 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372fb076-a884-4bdd-aa27-37f4a547781c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:04.071263 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372fb076-a884-4bdd-aa27-37f4a547781c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:04.071675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372fb076-a884-4bdd-aa27-37f4a547781c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:04.209384 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-372fb076-a884-4bdd-aa27-37f4a547781c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:04.217077 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-372fb076-a884-4bdd-aa27-37f4a547781c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.159193 Aug 12 06:50:04.218331 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 128/247] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:04 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:04.236589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:04.237231 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:04.243822 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:04.244388 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:04.244840 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:04.245578 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:04.246032 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:04.246451 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:04.387026 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:04.396796 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:04.398838 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:04.399854 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9c17750d-10af-4b26-82ec-e6b14273936e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.168045 Aug 12 06:50:04.400469 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 120/248] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:04 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:05.246100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-22062086-be53-433a-9320-e7f93875b629 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:05.247146 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-22062086-be53-433a-9320-e7f93875b629 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:05.257079 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22062086-be53-433a-9320-e7f93875b629 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:05.257834 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22062086-be53-433a-9320-e7f93875b629 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:05.258940 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22062086-be53-433a-9320-e7f93875b629 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:05.259826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22062086-be53-433a-9320-e7f93875b629 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:05.260249 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22062086-be53-433a-9320-e7f93875b629 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:05.260690 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22062086-be53-433a-9320-e7f93875b629 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:05.397995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-22062086-be53-433a-9320-e7f93875b629 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:05.407242 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-22062086-be53-433a-9320-e7f93875b629 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.170604 Aug 12 06:50:05.407844 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 129/249] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:05 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:05.423183 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:05.423756 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:05.430430 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:05.430884 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:05.431376 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:05.432151 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:05.432602 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:05.433018 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:05.570086 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:05.578625 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:05.580190 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:05.581348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6bcba2d0-df02-4d4f-a0af-69e9c1ebafb0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.162182 Aug 12 06:50:05.581931 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 121/250] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:05 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:06.431841 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3d05a6e5-e71e-420f-adc3-d7d4a109d915 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:06.432460 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3d05a6e5-e71e-420f-adc3-d7d4a109d915 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:06.439781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d05a6e5-e71e-420f-adc3-d7d4a109d915 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:06.440332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d05a6e5-e71e-420f-adc3-d7d4a109d915 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:06.440828 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d05a6e5-e71e-420f-adc3-d7d4a109d915 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:06.441616 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d05a6e5-e71e-420f-adc3-d7d4a109d915 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:06.442138 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d05a6e5-e71e-420f-adc3-d7d4a109d915 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:06.442622 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d05a6e5-e71e-420f-adc3-d7d4a109d915 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:06.579405 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3d05a6e5-e71e-420f-adc3-d7d4a109d915 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:06.590839 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3d05a6e5-e71e-420f-adc3-d7d4a109d915 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.165201 Aug 12 06:50:06.591445 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 130/251] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:06 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:06.607009 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:06.607737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:06.618069 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:06.618821 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:06.619479 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:06.620562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:06.621195 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:06.621761 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:06.760819 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:06.773572 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:06.775877 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:06.777608 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-36f08c5f-1e01-46f1-a762-1fad8ebfa9f9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.175297 Aug 12 06:50:06.778440 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 122/252] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:06 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:07.620106 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d8ec3e06-6279-43d8-9a87-d751a791638b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:07.621081 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d8ec3e06-6279-43d8-9a87-d751a791638b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:07.630924 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8ec3e06-6279-43d8-9a87-d751a791638b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:07.631759 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8ec3e06-6279-43d8-9a87-d751a791638b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:07.632462 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8ec3e06-6279-43d8-9a87-d751a791638b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:07.633571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8ec3e06-6279-43d8-9a87-d751a791638b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:07.634310 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8ec3e06-6279-43d8-9a87-d751a791638b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:07.634937 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8ec3e06-6279-43d8-9a87-d751a791638b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:07.769045 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d8ec3e06-6279-43d8-9a87-d751a791638b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:07.777017 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d8ec3e06-6279-43d8-9a87-d751a791638b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1501 microversion: 2.1 time: 0.163386 Aug 12 06:50:07.777583 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 131/253] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:07 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:07.797129 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7b6e338-5d75-406a-a297-7acfaf6cc2f3"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:07.799572 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:07.806277 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:07.807102 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:07.807567 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:07.807902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:07.808245 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:07.808499 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:07.808666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:07.809082 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:07.814370 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:07.814844 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:07.815299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:07.815982 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:07.816425 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:07.816836 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:07.832682 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] HTTP exception thrown: Cannot 'attach_volume' instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e while it is in vm_state rescued Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Request method failure captured: Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: POST /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e/os-volume_attachments HTTP/1.1 Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 74 Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9feYq1WRxO1Mn164rhUCBzm3LFDxqEbHN0rZaCFppVUvY401Qo_9blAqxE1jSwnwng7ImaGb5PIbVbYQeOFbAubwTc9U1tEAi7xvUnwMVElhSMnvIl7Uh5962LmQALoPj8xHxamxpdP9xZrB6QoQdnWuhnf8Qeu0j7Yg5UC9bC_VafY Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 9871a1ac34bd4164bd662499cf299cbe Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:50:07.834945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9871a1ac34bd4164bd662499cf299cbe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 9871a1ac34bd4164bd662499cf299cbe Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-ServerRescueNegativeTestJSON-1861263750-project Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: cf53f022a26d48b3aa70cea4f5fbc1c3 Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1861263750-project Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {"volumeAttachment": {"volumeId": "c7b6e338-5d75-406a-a297-7acfaf6cc2f3"}} Aug 12 06:50:07.836390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Cannot 'attach_volume' instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e while it is in vm_state rescued Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'server_id': '408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e', 'body': {'volumeAttachment': {'volumeId': 'c7b6e338-5d75-406a-a297-7acfaf6cc2f3'}}} Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:50:07.841143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e while it is in vm_state rescued Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:50:07.842448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:50:07.843676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:50:07.843676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:50:07.843676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e while it is in vm_state rescued Aug 12 06:50:07.843676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:50:07.843676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Returning 409 to user: Cannot 'attach_volume' instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e while it is in vm_state rescued {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:50:07.843676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0e042961-398c-415f-ad05-77cb1b1bed83 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "POST /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043391 Aug 12 06:50:07.843676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 123/254] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:50:07 2022] POST /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 12 06:50:07.846575 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2c513b0b-4b4a-4838-b94b-283d64018c5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:07.847203 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2c513b0b-4b4a-4838-b94b-283d64018c5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:07.853837 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c513b0b-4b4a-4838-b94b-283d64018c5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:07.854332 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c513b0b-4b4a-4838-b94b-283d64018c5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:07.854760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c513b0b-4b4a-4838-b94b-283d64018c5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:07.855465 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c513b0b-4b4a-4838-b94b-283d64018c5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:07.855947 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c513b0b-4b4a-4838-b94b-283d64018c5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:07.856364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c513b0b-4b4a-4838-b94b-283d64018c5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:07.942168 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2c513b0b-4b4a-4838-b94b-283d64018c5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "POST /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e/action" status: 202 len: 0 microversion: 2.1 time: 0.099544 Aug 12 06:50:07.942794 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 124/255] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:50:07 2022] POST /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:50:07.952077 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8ffb3a09-9c30-413d-bf6e-970b4e40f1ec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:07.952882 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8ffb3a09-9c30-413d-bf6e-970b4e40f1ec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:07.959551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ffb3a09-9c30-413d-bf6e-970b4e40f1ec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:07.960102 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ffb3a09-9c30-413d-bf6e-970b4e40f1ec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:07.960707 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ffb3a09-9c30-413d-bf6e-970b4e40f1ec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:07.961422 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ffb3a09-9c30-413d-bf6e-970b4e40f1ec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:07.969290 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ffb3a09-9c30-413d-bf6e-970b4e40f1ec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:07.969290 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ffb3a09-9c30-413d-bf6e-970b4e40f1ec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:08.169223 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8ffb3a09-9c30-413d-bf6e-970b4e40f1ec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:08.172557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:08.177475 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8ffb3a09-9c30-413d-bf6e-970b4e40f1ec tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1509 microversion: 2.1 time: 0.229862 Aug 12 06:50:08.178855 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 125/256] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:07 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:08.181451 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:08.182993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:08.184141 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c02f2373-03e8-45cb-8d6a-5e3d74223221 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.380153 Aug 12 06:50:08.184987 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 132/257] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:07 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:50:09.201667 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b7605aea-a626-4368-b42a-8880321d50d1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:09.202822 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b7605aea-a626-4368-b42a-8880321d50d1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:09.211194 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:09.212221 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:09.213324 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7605aea-a626-4368-b42a-8880321d50d1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:09.213806 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7605aea-a626-4368-b42a-8880321d50d1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:09.214233 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7605aea-a626-4368-b42a-8880321d50d1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:09.214914 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7605aea-a626-4368-b42a-8880321d50d1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:09.215387 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7605aea-a626-4368-b42a-8880321d50d1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:09.215801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7605aea-a626-4368-b42a-8880321d50d1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:09.218484 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:09.218962 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:09.219402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:09.220351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:09.220794 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:09.221221 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:09.405880 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b7605aea-a626-4368-b42a-8880321d50d1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:09.409912 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:09.413685 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b7605aea-a626-4368-b42a-8880321d50d1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1509 microversion: 2.1 time: 0.218228 Aug 12 06:50:09.414252 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 126/258] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:09 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:09.418359 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:09.419846 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:09.421028 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a61d63bb-ac69-4805-b6c9-7dac7f73bb53 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.216494 Aug 12 06:50:09.421568 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 133/259] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:09 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:10.439606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-570801e8-0418-4fb8-b1c4-e857e721d8e7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:10.444624 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-570801e8-0418-4fb8-b1c4-e857e721d8e7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:10.447890 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:10.448515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:10.452393 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-570801e8-0418-4fb8-b1c4-e857e721d8e7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:10.452883 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-570801e8-0418-4fb8-b1c4-e857e721d8e7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:10.453472 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-570801e8-0418-4fb8-b1c4-e857e721d8e7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:10.454192 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-570801e8-0418-4fb8-b1c4-e857e721d8e7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:10.454666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-570801e8-0418-4fb8-b1c4-e857e721d8e7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:10.455102 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-570801e8-0418-4fb8-b1c4-e857e721d8e7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:10.455656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:10.456166 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:10.456623 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:10.457355 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:10.457834 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:10.458305 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:10.705860 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:10.709223 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-570801e8-0418-4fb8-b1c4-e857e721d8e7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:10.717338 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-570801e8-0418-4fb8-b1c4-e857e721d8e7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1509 microversion: 2.1 time: 0.284952 Aug 12 06:50:10.717890 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:10.719642 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:10.721165 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fcad2c1d-403a-421b-9512-434ad2c3cec9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.279523 Aug 12 06:50:10.722261 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 134/260] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:10 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:10.731448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 127/261] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:10 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1509 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:11.487423 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ab4c017c-b8cf-4a5a-bc40-e87ecdd927df tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: .version_select at 0x7fc70522ec10>, body: {"keypair": {"name": "tempest-keypair-1153866364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDAmFX811aHrf8wwbzhIXVR5RLKYu09d5J71ZwAPecA1yx8qg7JKMzHvVLF9XzJe5+WwmXqerJt7db+FyPqAGimQeACZ0m0AUqqZ+XZqY5b9Cs49v19B4TJCtxQKuVDYg=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:11.504421 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-ab4c017c-b8cf-4a5a-bc40-e87ecdd927df tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for project b89f418ef5fd41b39c0a0a36968da428. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:50:11.509556 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-ab4c017c-b8cf-4a5a-bc40-e87ecdd927df tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for user 342ef719c63d4fbfa5a2a3943bd3b24b and project b89f418ef5fd41b39c0a0a36968da428. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:50:11.537569 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ab4c017c-b8cf-4a5a-bc40-e87ecdd927df tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054154 Aug 12 06:50:11.544263 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 135/262] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 06:50:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:50:11.749707 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-25f1567b-54eb-4e85-823e-af49397ba1a5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:11.750633 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-25f1567b-54eb-4e85-823e-af49397ba1a5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:11.755184 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:11.755832 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:11.758150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-25f1567b-54eb-4e85-823e-af49397ba1a5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:11.759280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-25f1567b-54eb-4e85-823e-af49397ba1a5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:11.759970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-25f1567b-54eb-4e85-823e-af49397ba1a5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:11.760803 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-25f1567b-54eb-4e85-823e-af49397ba1a5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:11.761381 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-25f1567b-54eb-4e85-823e-af49397ba1a5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:11.761896 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-25f1567b-54eb-4e85-823e-af49397ba1a5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:11.764488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:11.768632 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:11.769115 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:11.769840 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:11.770299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:11.770717 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:11.994332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:12.004928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-25f1567b-54eb-4e85-823e-af49397ba1a5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:12.006109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:12.009310 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:12.011398 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a0e950d4-c290-436e-b547-cd0c63498685 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.260618 Aug 12 06:50:12.012384 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 136/263] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:11 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:12.019119 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-25f1567b-54eb-4e85-823e-af49397ba1a5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1509 microversion: 2.1 time: 0.272866 Aug 12 06:50:12.020474 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 128/264] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:11 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1509 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:13.035576 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:13.036388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:13.042379 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2c45c9b2-0218-451c-ba47-020a664bb08f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:13.044355 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2c45c9b2-0218-451c-ba47-020a664bb08f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:13.046792 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:13.047328 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:13.047776 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:13.048707 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:13.049626 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:13.051462 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:13.058831 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c45c9b2-0218-451c-ba47-020a664bb08f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:13.059674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c45c9b2-0218-451c-ba47-020a664bb08f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:13.060873 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c45c9b2-0218-451c-ba47-020a664bb08f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:13.062066 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c45c9b2-0218-451c-ba47-020a664bb08f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:13.062740 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c45c9b2-0218-451c-ba47-020a664bb08f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:13.063450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c45c9b2-0218-451c-ba47-020a664bb08f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:13.291919 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:13.305258 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2c45c9b2-0218-451c-ba47-020a664bb08f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:13.306558 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:13.308105 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:13.309261 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-454ebbb1-4b4b-41bc-96db-15dc0933a470 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.277631 Aug 12 06:50:13.310725 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 137/265] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:13 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:13.317959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2c45c9b2-0218-451c-ba47-020a664bb08f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1509 microversion: 2.1 time: 0.281661 Aug 12 06:50:13.335012 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-475087040", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f384a833-4d30-4845-aa83-a1cad46c6a6b"}], "security_groups": [{"name": "tempest-securitygroup--1987050303"}], "key_name": "tempest-keypair-1153866364", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:13.339732 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 129/266] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:13 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:13.497681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] validate_networks() for [('f384a833-4d30-4845-aa83-a1cad46c6a6b', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:50:13.978213 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:50:13.978740 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:50:13.979561 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:50:13.980453 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:50:13.981035 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:50:13.983491 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:13.993464 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:13.994066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:13.994412 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:13.998634 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:13.998634 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:13.998634 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:14.015653 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for project b89f418ef5fd41b39c0a0a36968da428. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:50:14.019407 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for user 342ef719c63d4fbfa5a2a3943bd3b24b and project b89f418ef5fd41b39c0a0a36968da428. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:50:14.033164 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:50:14.036000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:50:14.089952 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-86b87b15-cc7e-4aa8-9e06-1443dd812050 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.778071 Aug 12 06:50:14.099160 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 138/267] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:50:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:50:14.102056 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e33d73ce-4bc2-4062-8fa4-8791ad5adbf7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:14.102798 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e33d73ce-4bc2-4062-8fa4-8791ad5adbf7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:14.172534 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e33d73ce-4bc2-4062-8fa4-8791ad5adbf7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:14.182773 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e33d73ce-4bc2-4062-8fa4-8791ad5adbf7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1241 microversion: 2.1 time: 0.083169 Aug 12 06:50:14.183494 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 130/268] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:14 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:14.334336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:14.335136 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:14.341683 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:14.342170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:14.342606 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:14.343333 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:14.343795 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:14.344192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:14.353590 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ed29b582-5f12-4ea9-aac2-2c83ce699632 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:14.354620 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ed29b582-5f12-4ea9-aac2-2c83ce699632 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:14.364254 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed29b582-5f12-4ea9-aac2-2c83ce699632 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:14.364940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed29b582-5f12-4ea9-aac2-2c83ce699632 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:14.365433 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed29b582-5f12-4ea9-aac2-2c83ce699632 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:14.366147 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed29b582-5f12-4ea9-aac2-2c83ce699632 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:14.366597 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed29b582-5f12-4ea9-aac2-2c83ce699632 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:14.367027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed29b582-5f12-4ea9-aac2-2c83ce699632 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:14.395342 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:14.572033 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ed29b582-5f12-4ea9-aac2-2c83ce699632 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:14.586278 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ed29b582-5f12-4ea9-aac2-2c83ce699632 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1515 microversion: 2.1 time: 0.242009 Aug 12 06:50:14.591142 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 131/269] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:14 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1515 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:14.597402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:14.623978 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:14.626348 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:14.628885 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-21c0e196-d653-4eb7-b898-99d22fdbac38 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1745 microversion: 2.20 time: 0.298059 Aug 12 06:50:14.645026 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 139/270] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:14 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1745 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:15.205095 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-69d99deb-62cf-476a-9ceb-f4e5c8fed0fa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:15.205820 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-69d99deb-62cf-476a-9ceb-f4e5c8fed0fa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:15.212806 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69d99deb-62cf-476a-9ceb-f4e5c8fed0fa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:15.213296 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69d99deb-62cf-476a-9ceb-f4e5c8fed0fa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:15.213740 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69d99deb-62cf-476a-9ceb-f4e5c8fed0fa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:15.214769 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69d99deb-62cf-476a-9ceb-f4e5c8fed0fa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:15.215247 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69d99deb-62cf-476a-9ceb-f4e5c8fed0fa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:15.215657 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69d99deb-62cf-476a-9ceb-f4e5c8fed0fa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:15.286229 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-69d99deb-62cf-476a-9ceb-f4e5c8fed0fa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:15.310775 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-69d99deb-62cf-476a-9ceb-f4e5c8fed0fa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1293 microversion: 2.1 time: 0.109915 Aug 12 06:50:15.311396 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 132/271] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:15 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:15.661393 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:15.664428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:15.672687 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:15.673265 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:15.673957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:15.674664 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:15.675386 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:15.676005 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:15.818824 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:15.827589 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:15.829184 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:15.830400 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-29d3e641-2cba-41d3-86cb-6e80eec36f1f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1745 microversion: 2.20 time: 0.176682 Aug 12 06:50:15.831006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 140/272] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:15 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:16.053381 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fc83ce02-4da4-4dfb-af90-852a01851723 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Action: 'create', calling method: .version_select at 0x7fc70520a040>, body: {"keypair": {"name": "tempest-keypair-510240058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXQXffBD5i/456damgkAtsBrOX9vpbQdh+vMesiC/+TZQQGmYRrOps9hHlh8Fabono8Up2ijCqV8+uRdalgepVqKOhoM6TN/LSibZMnY5GspYssXcgZTtGMtjiICVVbAQ=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:16.069620 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-fc83ce02-4da4-4dfb-af90-852a01851723 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Getting quotas for project 9871a1ac34bd4164bd662499cf299cbe. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:50:16.073511 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-fc83ce02-4da4-4dfb-af90-852a01851723 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Getting quotas for user cf53f022a26d48b3aa70cea4f5fbc1c3 and project 9871a1ac34bd4164bd662499cf299cbe. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:50:16.101175 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fc83ce02-4da4-4dfb-af90-852a01851723 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051697 Aug 12 06:50:16.102019 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 133/273] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 06:50:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:50:16.332256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1af2c104-e22a-481e-8ffe-26091e513d75 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:16.333271 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1af2c104-e22a-481e-8ffe-26091e513d75 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:16.346132 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af2c104-e22a-481e-8ffe-26091e513d75 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:16.346826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af2c104-e22a-481e-8ffe-26091e513d75 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:16.347373 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af2c104-e22a-481e-8ffe-26091e513d75 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:16.348326 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af2c104-e22a-481e-8ffe-26091e513d75 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:16.348974 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af2c104-e22a-481e-8ffe-26091e513d75 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:16.349585 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af2c104-e22a-481e-8ffe-26091e513d75 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:16.655970 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1af2c104-e22a-481e-8ffe-26091e513d75 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:16.663596 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1af2c104-e22a-481e-8ffe-26091e513d75 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.335271 Aug 12 06:50:16.664205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 141/274] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:16 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:16.857442 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:16.858585 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:16.864789 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:16.865479 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:16.865914 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:16.866613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:16.867078 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:16.867699 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:17.007851 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:17.016186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:17.017811 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:17.019176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b7e35b8c-40eb-4004-819b-f0b9e58c8612 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1745 microversion: 2.20 time: 0.169641 Aug 12 06:50:17.019946 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 134/275] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:16 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:17.526287 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1604831536", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85d9adca-c1e4-4674-a4ec-42c68e097d7e"}], "security_groups": [{"name": "tempest-securitygroup--2024565405"}], "key_name": "tempest-keypair-510240058", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:17.635192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] validate_networks() for [('85d9adca-c1e4-4674-a4ec-42c68e097d7e', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:50:17.691095 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a53a6937-a71e-4249-ac52-b4ce154fb8e9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:17.691967 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a53a6937-a71e-4249-ac52-b4ce154fb8e9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:17.698183 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a53a6937-a71e-4249-ac52-b4ce154fb8e9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:17.698684 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a53a6937-a71e-4249-ac52-b4ce154fb8e9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:17.699126 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a53a6937-a71e-4249-ac52-b4ce154fb8e9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:17.699825 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a53a6937-a71e-4249-ac52-b4ce154fb8e9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:17.700276 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a53a6937-a71e-4249-ac52-b4ce154fb8e9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:17.700760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a53a6937-a71e-4249-ac52-b4ce154fb8e9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:17.909593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a53a6937-a71e-4249-ac52-b4ce154fb8e9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:17.924859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a53a6937-a71e-4249-ac52-b4ce154fb8e9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.238124 Aug 12 06:50:17.925499 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 135/276] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:17 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:18.043233 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:18.043820 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:18.050082 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:18.050558 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:18.050996 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:18.051703 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:18.052203 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:18.052565 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:18.090027 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:50:18.090507 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:50:18.090948 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:50:18.091775 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:50:18.092233 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:50:18.101517 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:18.102358 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:18.103016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:18.103887 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:18.104488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:18.104907 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:18.122219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Getting quotas for project 9871a1ac34bd4164bd662499cf299cbe. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:50:18.126092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Getting quotas for user cf53f022a26d48b3aa70cea4f5fbc1c3 and project 9871a1ac34bd4164bd662499cf299cbe. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:50:18.142256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:50:18.144650 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:50:18.189489 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:18.192493 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fff8ab06-5371-4403-bfe4-9fa5ca8c38be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.670523 Aug 12 06:50:18.193250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 142/277] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:50:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:50:18.198117 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:18.199968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:18.201195 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e225d867-273a-46d4-8919-7c9f8f758f6b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1745 microversion: 2.20 time: 0.162101 Aug 12 06:50:18.202033 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 136/278] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:18 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:18.204283 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3cdf1b7b-3541-4542-ab58-2214fb73aebb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:18.204923 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3cdf1b7b-3541-4542-ab58-2214fb73aebb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:18.264667 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3cdf1b7b-3541-4542-ab58-2214fb73aebb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:18.276359 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3cdf1b7b-3541-4542-ab58-2214fb73aebb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1245 microversion: 2.1 time: 0.076277 Aug 12 06:50:18.276911 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 143/279] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:18 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:18.946167 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7407bc5e-cee7-4c1e-aa3e-7ecd788f0918 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:18.946838 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7407bc5e-cee7-4c1e-aa3e-7ecd788f0918 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:18.954579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7407bc5e-cee7-4c1e-aa3e-7ecd788f0918 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:18.955092 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7407bc5e-cee7-4c1e-aa3e-7ecd788f0918 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:18.957684 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7407bc5e-cee7-4c1e-aa3e-7ecd788f0918 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:18.958407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7407bc5e-cee7-4c1e-aa3e-7ecd788f0918 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:18.960964 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7407bc5e-cee7-4c1e-aa3e-7ecd788f0918 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:18.961391 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7407bc5e-cee7-4c1e-aa3e-7ecd788f0918 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:19.169844 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7407bc5e-cee7-4c1e-aa3e-7ecd788f0918 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:19.183292 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7407bc5e-cee7-4c1e-aa3e-7ecd788f0918 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.238341 Aug 12 06:50:19.183292 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 137/280] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:18 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:19.227172 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:19.229263 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:19.237776 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:19.238289 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:19.238770 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:19.239485 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:19.241054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:19.246765 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:19.299649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-26def8ae-24a2-4315-813b-90e87d8f4ab1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:19.300260 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-26def8ae-24a2-4315-813b-90e87d8f4ab1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:19.306964 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26def8ae-24a2-4315-813b-90e87d8f4ab1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:19.307489 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26def8ae-24a2-4315-813b-90e87d8f4ab1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:19.307924 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26def8ae-24a2-4315-813b-90e87d8f4ab1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:19.308642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26def8ae-24a2-4315-813b-90e87d8f4ab1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:19.309093 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26def8ae-24a2-4315-813b-90e87d8f4ab1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:19.309522 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26def8ae-24a2-4315-813b-90e87d8f4ab1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:19.409070 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-26def8ae-24a2-4315-813b-90e87d8f4ab1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:19.417413 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-26def8ae-24a2-4315-813b-90e87d8f4ab1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1297 microversion: 2.1 time: 0.124159 Aug 12 06:50:19.417989 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 138/281] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:19 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:19.422698 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-ef20f372-53d8-4a35-aee3-44a8cf32f18d req-b060ec44-9e36-485f-84e7-ecbf9c1cd7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bc12e0-d758-47a7-920d-971a6e993711", "name": "network-vif-plugged", "status": "completed", "tag": "2de31bfc-bbcb-4a81-989c-adfbe72a2aac"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:19.432934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ef20f372-53d8-4a35-aee3-44a8cf32f18d req-b060ec44-9e36-485f-84e7-ecbf9c1cd7ce service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:19.433649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ef20f372-53d8-4a35-aee3-44a8cf32f18d req-b060ec44-9e36-485f-84e7-ecbf9c1cd7ce service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:19.434271 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ef20f372-53d8-4a35-aee3-44a8cf32f18d req-b060ec44-9e36-485f-84e7-ecbf9c1cd7ce service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:19.448084 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-ef20f372-53d8-4a35-aee3-44a8cf32f18d req-b060ec44-9e36-485f-84e7-ecbf9c1cd7ce service nova] Creating event network-vif-plugged:2de31bfc-bbcb-4a81-989c-adfbe72a2aac for instance a6bc12e0-d758-47a7-920d-971a6e993711 on hv-cinder-84457 Aug 12 06:50:19.454405 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-ef20f372-53d8-4a35-aee3-44a8cf32f18d req-b060ec44-9e36-485f-84e7-ecbf9c1cd7ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034987 Aug 12 06:50:19.455035 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 139/282] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:50:19.524714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:19.536942 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:19.538527 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:19.539948 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-56a902de-d5d2-44f2-9f7d-5c92174a45fb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1745 microversion: 2.20 time: 0.318791 Aug 12 06:50:19.540693 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 144/283] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:19 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1745 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:19.661145 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-592315f9-38dd-4a3d-856d-96fb1b56118f req-a371b2ea-0748-4a51-82c0-1120abdac81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205712a3-060e-4c1a-a2c2-dd9130af8577", "tag": "60906462-e7fb-48a2-911f-43a5cce62879"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:19.671766 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-592315f9-38dd-4a3d-856d-96fb1b56118f req-a371b2ea-0748-4a51-82c0-1120abdac81b service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:19.672328 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-592315f9-38dd-4a3d-856d-96fb1b56118f req-a371b2ea-0748-4a51-82c0-1120abdac81b service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:19.672852 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-592315f9-38dd-4a3d-856d-96fb1b56118f req-a371b2ea-0748-4a51-82c0-1120abdac81b service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:19.684288 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-592315f9-38dd-4a3d-856d-96fb1b56118f req-a371b2ea-0748-4a51-82c0-1120abdac81b service nova] Creating event network-changed:60906462-e7fb-48a2-911f-43a5cce62879 for instance 205712a3-060e-4c1a-a2c2-dd9130af8577 on hv-cinder-84457 Aug 12 06:50:19.689195 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-592315f9-38dd-4a3d-856d-96fb1b56118f req-a371b2ea-0748-4a51-82c0-1120abdac81b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032827 Aug 12 06:50:19.689777 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 140/284] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:50:20.207049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4b25969e-c7ec-4c29-8ac3-cc20384bb477 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:20.207899 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4b25969e-c7ec-4c29-8ac3-cc20384bb477 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:20.218130 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b25969e-c7ec-4c29-8ac3-cc20384bb477 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:20.218924 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b25969e-c7ec-4c29-8ac3-cc20384bb477 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:20.219695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b25969e-c7ec-4c29-8ac3-cc20384bb477 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:20.220835 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b25969e-c7ec-4c29-8ac3-cc20384bb477 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:20.221582 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b25969e-c7ec-4c29-8ac3-cc20384bb477 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:20.222279 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b25969e-c7ec-4c29-8ac3-cc20384bb477 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:20.442161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-447223df-dfd3-43f8-8175-cf7812283f89 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:20.442865 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-447223df-dfd3-43f8-8175-cf7812283f89 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:20.454839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-447223df-dfd3-43f8-8175-cf7812283f89 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:20.455897 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-447223df-dfd3-43f8-8175-cf7812283f89 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:20.456492 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-447223df-dfd3-43f8-8175-cf7812283f89 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:20.457426 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-447223df-dfd3-43f8-8175-cf7812283f89 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:20.458034 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-447223df-dfd3-43f8-8175-cf7812283f89 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:20.458807 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-447223df-dfd3-43f8-8175-cf7812283f89 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:20.727439 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4b25969e-c7ec-4c29-8ac3-cc20384bb477 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:20.735350 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4b25969e-c7ec-4c29-8ac3-cc20384bb477 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.534580 Aug 12 06:50:20.751665 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 145/285] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:20 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:20.756983 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:20.757806 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:20.765336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:20.766116 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:20.774947 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:20.776595 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:20.776927 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-447223df-dfd3-43f8-8175-cf7812283f89 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:20.777421 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:20.777895 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:20.786022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-447223df-dfd3-43f8-8175-cf7812283f89 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1303 microversion: 2.1 time: 0.349722 Aug 12 06:50:20.787424 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 141/286] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:20 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1303 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:21.059156 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:21.061746 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:21.074190 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:21.076043 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:21.077705 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-847a79d6-a59a-4610-9666-738e83e9f99c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1740 microversion: 2.20 time: 0.324793 Aug 12 06:50:21.078515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 146/287] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:20 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1740 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:21.759162 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b30c8ed5-c326-4d16-9b96-22fa52615402 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:21.760542 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b30c8ed5-c326-4d16-9b96-22fa52615402 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:21.775061 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c8ed5-c326-4d16-9b96-22fa52615402 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:21.775808 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c8ed5-c326-4d16-9b96-22fa52615402 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:21.776446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c8ed5-c326-4d16-9b96-22fa52615402 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:21.777337 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c8ed5-c326-4d16-9b96-22fa52615402 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:21.777790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c8ed5-c326-4d16-9b96-22fa52615402 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:21.778218 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b30c8ed5-c326-4d16-9b96-22fa52615402 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:21.808094 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c614c6c1-d869-42f3-b1ed-5c389551d480 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:21.810173 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c614c6c1-d869-42f3-b1ed-5c389551d480 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:21.822003 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c614c6c1-d869-42f3-b1ed-5c389551d480 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:21.824256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c614c6c1-d869-42f3-b1ed-5c389551d480 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:21.825056 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c614c6c1-d869-42f3-b1ed-5c389551d480 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:21.826888 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c614c6c1-d869-42f3-b1ed-5c389551d480 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:21.827959 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c614c6c1-d869-42f3-b1ed-5c389551d480 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:21.829218 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c614c6c1-d869-42f3-b1ed-5c389551d480 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:22.019094 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c614c6c1-d869-42f3-b1ed-5c389551d480 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:22.028743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c614c6c1-d869-42f3-b1ed-5c389551d480 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1303 microversion: 2.1 time: 0.225365 Aug 12 06:50:22.039895 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 147/288] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:21 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1303 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:22.099696 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c5320b30-28b4-4ed0-8c0a-5c3f38e6d170 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:22.106368 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5320b30-28b4-4ed0-8c0a-5c3f38e6d170 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:22.107233 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5320b30-28b4-4ed0-8c0a-5c3f38e6d170 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:22.107816 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5320b30-28b4-4ed0-8c0a-5c3f38e6d170 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:22.176624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c5320b30-28b4-4ed0-8c0a-5c3f38e6d170 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Going to try to stop instance {{(pid=127088) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 12 06:50:22.207203 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b30c8ed5-c326-4d16-9b96-22fa52615402 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:22.217798 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b30c8ed5-c326-4d16-9b96-22fa52615402 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.462460 Aug 12 06:50:22.231364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 142/289] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:21 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:22.244690 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:22.245591 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:22.252851 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:22.253700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:22.254485 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:22.256805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:22.257653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:22.258524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:22.290955 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c5320b30-28b4-4ed0-8c0a-5c3f38e6d170 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "POST /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/action" status: 202 len: 0 microversion: 2.1 time: 0.194760 Aug 12 06:50:22.292114 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 148/290] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:50:22 2022] POST /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:50:22.322660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cae49ed6-fd03-4eec-aeb5-35fa1c544e33 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:22.326465 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cae49ed6-fd03-4eec-aeb5-35fa1c544e33 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:22.338219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cae49ed6-fd03-4eec-aeb5-35fa1c544e33 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:22.339104 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cae49ed6-fd03-4eec-aeb5-35fa1c544e33 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:22.339770 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cae49ed6-fd03-4eec-aeb5-35fa1c544e33 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:22.341705 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cae49ed6-fd03-4eec-aeb5-35fa1c544e33 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:22.342452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cae49ed6-fd03-4eec-aeb5-35fa1c544e33 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:22.343112 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cae49ed6-fd03-4eec-aeb5-35fa1c544e33 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:22.608561 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:22.636490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:22.646373 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:22.648752 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ca03f300-1ac5-44d5-ac58-5a08229f431c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1740 microversion: 2.20 time: 0.416018 Aug 12 06:50:22.658735 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 143/291] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:22 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:22.783989 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cae49ed6-fd03-4eec-aeb5-35fa1c544e33 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:22.796082 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cae49ed6-fd03-4eec-aeb5-35fa1c544e33 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.490130 Aug 12 06:50:22.796679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 149/292] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:22 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:23.062745 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b4b4e4bb-a406-4a5d-a42b-8a762bcf6a9e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:23.064330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b4b4e4bb-a406-4a5d-a42b-8a762bcf6a9e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:23.071650 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:23.102412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4b4e4bb-a406-4a5d-a42b-8a762bcf6a9e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:23.118356 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4b4e4bb-a406-4a5d-a42b-8a762bcf6a9e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:23.119351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4b4e4bb-a406-4a5d-a42b-8a762bcf6a9e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:23.119351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4b4e4bb-a406-4a5d-a42b-8a762bcf6a9e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:23.119351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4b4e4bb-a406-4a5d-a42b-8a762bcf6a9e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:23.119351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4b4e4bb-a406-4a5d-a42b-8a762bcf6a9e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:23.246832 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-33bebdc3-a752-4055-bd34-15b641bcffa6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:23.247626 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-33bebdc3-a752-4055-bd34-15b641bcffa6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:23.257289 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33bebdc3-a752-4055-bd34-15b641bcffa6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:23.257781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33bebdc3-a752-4055-bd34-15b641bcffa6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:23.258502 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33bebdc3-a752-4055-bd34-15b641bcffa6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:23.259455 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33bebdc3-a752-4055-bd34-15b641bcffa6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:23.260125 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33bebdc3-a752-4055-bd34-15b641bcffa6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:23.260686 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33bebdc3-a752-4055-bd34-15b641bcffa6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:23.556260 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b4b4e4bb-a406-4a5d-a42b-8a762bcf6a9e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:23.567085 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b4b4e4bb-a406-4a5d-a42b-8a762bcf6a9e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1371 microversion: 2.1 time: 0.510006 Aug 12 06:50:23.569176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 144/293] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:23 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1371 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:23.613886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-33bebdc3-a752-4055-bd34-15b641bcffa6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:23.621703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-33bebdc3-a752-4055-bd34-15b641bcffa6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.379093 Aug 12 06:50:23.622192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 150/294] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:23 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:23.688912 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:23.689782 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:23.698696 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:23.700123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:23.700938 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:23.701860 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:23.702656 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:23.703322 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:23.760104 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-0b42540f-a878-42ec-a622-ba0377e3e915 req-262c6394-a076-48be-a2a5-75acb49803ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1d2c7f-0786-4d54-8a52-d1d3deac1f29", "tag": "09e645cd-262e-494b-8463-19e7e2065876"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:23.787123 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0b42540f-a878-42ec-a622-ba0377e3e915 req-262c6394-a076-48be-a2a5-75acb49803ab service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:23.788924 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0b42540f-a878-42ec-a622-ba0377e3e915 req-262c6394-a076-48be-a2a5-75acb49803ab service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:23.791908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0b42540f-a878-42ec-a622-ba0377e3e915 req-262c6394-a076-48be-a2a5-75acb49803ab service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:23.809175 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-0b42540f-a878-42ec-a622-ba0377e3e915 req-262c6394-a076-48be-a2a5-75acb49803ab service nova] Creating event network-changed:09e645cd-262e-494b-8463-19e7e2065876 for instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 on hv-cinder-84457 Aug 12 06:50:23.816167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-0b42540f-a878-42ec-a622-ba0377e3e915 req-262c6394-a076-48be-a2a5-75acb49803ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059048 Aug 12 06:50:23.834175 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 151/295] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:50:23.847180 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bd98bf88-38c9-4801-9df3-ac7cb1f47027 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:23.848004 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bd98bf88-38c9-4801-9df3-ac7cb1f47027 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:23.863833 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd98bf88-38c9-4801-9df3-ac7cb1f47027 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:23.864542 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd98bf88-38c9-4801-9df3-ac7cb1f47027 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:23.864968 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd98bf88-38c9-4801-9df3-ac7cb1f47027 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:23.865840 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd98bf88-38c9-4801-9df3-ac7cb1f47027 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:23.866503 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd98bf88-38c9-4801-9df3-ac7cb1f47027 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:23.867264 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd98bf88-38c9-4801-9df3-ac7cb1f47027 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:24.116428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:24.125858 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:24.127405 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:24.128645 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-46c944df-933a-405f-9330-705cf78f32df tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1740 microversion: 2.20 time: 0.444174 Aug 12 06:50:24.129282 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 145/296] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:23 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1740 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:24.243898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bd98bf88-38c9-4801-9df3-ac7cb1f47027 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:24.259838 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bd98bf88-38c9-4801-9df3-ac7cb1f47027 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.423305 Aug 12 06:50:24.261781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 152/297] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:23 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:24.598169 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6ea8360f-8bd1-4e3a-a525-754fd3800407 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:24.598841 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6ea8360f-8bd1-4e3a-a525-754fd3800407 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:24.607518 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ea8360f-8bd1-4e3a-a525-754fd3800407 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:24.608053 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ea8360f-8bd1-4e3a-a525-754fd3800407 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:24.608473 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ea8360f-8bd1-4e3a-a525-754fd3800407 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:24.609528 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ea8360f-8bd1-4e3a-a525-754fd3800407 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:24.609991 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ea8360f-8bd1-4e3a-a525-754fd3800407 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:24.610690 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ea8360f-8bd1-4e3a-a525-754fd3800407 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:24.653399 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-83306ae7-8b46-413f-bb13-b3d53482d5d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:24.653915 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-83306ae7-8b46-413f-bb13-b3d53482d5d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:24.665855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83306ae7-8b46-413f-bb13-b3d53482d5d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:24.667396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83306ae7-8b46-413f-bb13-b3d53482d5d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:24.667881 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83306ae7-8b46-413f-bb13-b3d53482d5d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:24.668589 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83306ae7-8b46-413f-bb13-b3d53482d5d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:24.669209 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83306ae7-8b46-413f-bb13-b3d53482d5d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:24.669615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83306ae7-8b46-413f-bb13-b3d53482d5d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:24.841377 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6ea8360f-8bd1-4e3a-a525-754fd3800407 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:24.850576 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6ea8360f-8bd1-4e3a-a525-754fd3800407 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1371 microversion: 2.1 time: 0.257478 Aug 12 06:50:24.851637 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 146/298] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:24 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:24.875688 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-83306ae7-8b46-413f-bb13-b3d53482d5d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:24.883564 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-83306ae7-8b46-413f-bb13-b3d53482d5d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.234878 Aug 12 06:50:24.884795 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 153/299] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:24 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:25.152853 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:25.154244 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:25.160893 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:25.161639 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:25.162132 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:25.162880 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:25.163558 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:25.164197 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:25.281553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-98893eee-6f96-45b5-b113-269b0352f8b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:25.282310 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-98893eee-6f96-45b5-b113-269b0352f8b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:25.290444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98893eee-6f96-45b5-b113-269b0352f8b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:25.293353 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98893eee-6f96-45b5-b113-269b0352f8b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:25.294166 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98893eee-6f96-45b5-b113-269b0352f8b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:25.296158 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98893eee-6f96-45b5-b113-269b0352f8b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:25.296836 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98893eee-6f96-45b5-b113-269b0352f8b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:25.297961 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98893eee-6f96-45b5-b113-269b0352f8b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:25.444263 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:25.453701 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:25.481217 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:25.482351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-909a93ef-bedb-4120-9430-01adb70cbf40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1740 microversion: 2.20 time: 0.333443 Aug 12 06:50:25.491957 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 147/300] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:25 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:25.585693 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-98893eee-6f96-45b5-b113-269b0352f8b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:25.604244 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-98893eee-6f96-45b5-b113-269b0352f8b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.326412 Aug 12 06:50:25.604876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 154/301] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:25 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:25.878450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b4635247-6bd4-440d-bfe1-15e1106b0ba9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:25.879894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b4635247-6bd4-440d-bfe1-15e1106b0ba9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:25.893476 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4635247-6bd4-440d-bfe1-15e1106b0ba9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:25.893968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4635247-6bd4-440d-bfe1-15e1106b0ba9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:25.898324 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4635247-6bd4-440d-bfe1-15e1106b0ba9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:25.899177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4635247-6bd4-440d-bfe1-15e1106b0ba9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:25.899870 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4635247-6bd4-440d-bfe1-15e1106b0ba9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:25.900303 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4635247-6bd4-440d-bfe1-15e1106b0ba9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:25.906398 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e1d1a531-b213-4310-8c35-f3d6e02f577b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:25.907016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e1d1a531-b213-4310-8c35-f3d6e02f577b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:25.924332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d1a531-b213-4310-8c35-f3d6e02f577b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:25.924918 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d1a531-b213-4310-8c35-f3d6e02f577b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:25.928883 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d1a531-b213-4310-8c35-f3d6e02f577b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:25.929667 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d1a531-b213-4310-8c35-f3d6e02f577b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:25.930135 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d1a531-b213-4310-8c35-f3d6e02f577b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:25.930563 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1d1a531-b213-4310-8c35-f3d6e02f577b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:26.081118 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:26.284666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b4635247-6bd4-440d-bfe1-15e1106b0ba9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:26.297124 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b4635247-6bd4-440d-bfe1-15e1106b0ba9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1371 microversion: 2.1 time: 0.427306 Aug 12 06:50:26.299270 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 148/302] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:25 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1371 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:26.344293 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e1d1a531-b213-4310-8c35-f3d6e02f577b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:26.376512 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e1d1a531-b213-4310-8c35-f3d6e02f577b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.472486 Aug 12 06:50:26.380084 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 155/303] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:25 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:26.514385 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:26.515364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:26.525384 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:26.528941 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:26.529582 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:26.530499 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:26.531159 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:26.531791 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:26.637974 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2c01e56d-b284-4d6a-8293-ae3884214824 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:26.638685 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2c01e56d-b284-4d6a-8293-ae3884214824 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:26.659679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c01e56d-b284-4d6a-8293-ae3884214824 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:26.660224 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c01e56d-b284-4d6a-8293-ae3884214824 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:26.660673 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c01e56d-b284-4d6a-8293-ae3884214824 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:26.661427 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c01e56d-b284-4d6a-8293-ae3884214824 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:26.661888 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c01e56d-b284-4d6a-8293-ae3884214824 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:26.662316 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c01e56d-b284-4d6a-8293-ae3884214824 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:27.091507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:27.106797 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:27.112424 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:27.113606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7d56f5d6-4c90-433a-828c-cfe81906eeb2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1740 microversion: 2.20 time: 0.603766 Aug 12 06:50:27.123946 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 149/304] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:26 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1740 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:27.148363 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2c01e56d-b284-4d6a-8293-ae3884214824 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:27.159149 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2c01e56d-b284-4d6a-8293-ae3884214824 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.531813 Aug 12 06:50:27.160670 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 156/305] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:26 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:27.317921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a8736038-983b-432b-b679-ffd50fd07a1e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:27.319249 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a8736038-983b-432b-b679-ffd50fd07a1e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:27.327436 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8736038-983b-432b-b679-ffd50fd07a1e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:27.327899 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8736038-983b-432b-b679-ffd50fd07a1e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:27.329220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8736038-983b-432b-b679-ffd50fd07a1e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:27.330443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8736038-983b-432b-b679-ffd50fd07a1e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:27.331077 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8736038-983b-432b-b679-ffd50fd07a1e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:27.331652 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8736038-983b-432b-b679-ffd50fd07a1e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:27.359028 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:27.397960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-218ff67c-5808-4757-bacf-af985259dccf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:27.398776 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-218ff67c-5808-4757-bacf-af985259dccf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:27.410340 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-218ff67c-5808-4757-bacf-af985259dccf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:27.410924 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-218ff67c-5808-4757-bacf-af985259dccf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:27.412910 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-218ff67c-5808-4757-bacf-af985259dccf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:27.413633 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-218ff67c-5808-4757-bacf-af985259dccf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:27.414086 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-218ff67c-5808-4757-bacf-af985259dccf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:27.414506 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-218ff67c-5808-4757-bacf-af985259dccf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:27.577093 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a8736038-983b-432b-b679-ffd50fd07a1e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:27.590685 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a8736038-983b-432b-b679-ffd50fd07a1e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1371 microversion: 2.1 time: 0.276516 Aug 12 06:50:27.591909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 150/306] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:27 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:27.596669 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-4529c1f6-efff-499f-b694-99108ffa3cab req-cfa7a6d0-3f07-4a16-b80f-076fc74c7f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205712a3-060e-4c1a-a2c2-dd9130af8577", "name": "network-vif-plugged", "status": "completed", "tag": "60906462-e7fb-48a2-911f-43a5cce62879"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:27.607442 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4529c1f6-efff-499f-b694-99108ffa3cab req-cfa7a6d0-3f07-4a16-b80f-076fc74c7f64 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:27.608428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4529c1f6-efff-499f-b694-99108ffa3cab req-cfa7a6d0-3f07-4a16-b80f-076fc74c7f64 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:27.609020 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4529c1f6-efff-499f-b694-99108ffa3cab req-cfa7a6d0-3f07-4a16-b80f-076fc74c7f64 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:27.622038 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-4529c1f6-efff-499f-b694-99108ffa3cab req-cfa7a6d0-3f07-4a16-b80f-076fc74c7f64 service nova] Creating event network-vif-plugged:60906462-e7fb-48a2-911f-43a5cce62879 for instance 205712a3-060e-4c1a-a2c2-dd9130af8577 on hv-cinder-84457 Aug 12 06:50:27.627233 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-4529c1f6-efff-499f-b694-99108ffa3cab req-cfa7a6d0-3f07-4a16-b80f-076fc74c7f64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033931 Aug 12 06:50:27.627811 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 151/307] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:50:27.668228 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-218ff67c-5808-4757-bacf-af985259dccf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:27.679466 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-218ff67c-5808-4757-bacf-af985259dccf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.285310 Aug 12 06:50:27.680129 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 157/308] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:27 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:28.148721 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:28.149836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:28.156424 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:28.157365 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:28.158155 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:28.159079 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:28.159749 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:28.160674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:28.184647 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b9647b6d-e072-4d17-8163-d6b6948a815f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:28.186653 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b9647b6d-e072-4d17-8163-d6b6948a815f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:28.191419 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:28.198503 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9647b6d-e072-4d17-8163-d6b6948a815f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:28.199332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9647b6d-e072-4d17-8163-d6b6948a815f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:28.199986 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9647b6d-e072-4d17-8163-d6b6948a815f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:28.200774 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9647b6d-e072-4d17-8163-d6b6948a815f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:28.201313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9647b6d-e072-4d17-8163-d6b6948a815f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:28.201934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9647b6d-e072-4d17-8163-d6b6948a815f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:28.273321 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=18 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:28.406104 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:28.410900 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b9647b6d-e072-4d17-8163-d6b6948a815f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:28.418354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:28.420650 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:28.421208 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b9647b6d-e072-4d17-8163-d6b6948a815f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.243298 Aug 12 06:50:28.422261 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 158/309] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:28 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:28.427080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3d1ff66a-1258-4bca-b535-b1d478725096 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1740 microversion: 2.20 time: 0.283436 Aug 12 06:50:28.428977 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 152/310] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:28 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:28.611779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-177e1a89-3f4b-4d39-93b9-1ae00889e9f7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:28.612630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-177e1a89-3f4b-4d39-93b9-1ae00889e9f7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:28.618860 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-177e1a89-3f4b-4d39-93b9-1ae00889e9f7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:28.619376 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-177e1a89-3f4b-4d39-93b9-1ae00889e9f7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:28.619998 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-177e1a89-3f4b-4d39-93b9-1ae00889e9f7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:28.620692 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-177e1a89-3f4b-4d39-93b9-1ae00889e9f7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:28.621144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-177e1a89-3f4b-4d39-93b9-1ae00889e9f7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:28.621682 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-177e1a89-3f4b-4d39-93b9-1ae00889e9f7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:28.701700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3662b943-e783-4c4a-9671-b1b2f99559bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:28.702514 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3662b943-e783-4c4a-9671-b1b2f99559bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:28.709170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3662b943-e783-4c4a-9671-b1b2f99559bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:28.709653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3662b943-e783-4c4a-9671-b1b2f99559bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:28.710076 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3662b943-e783-4c4a-9671-b1b2f99559bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:28.710769 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3662b943-e783-4c4a-9671-b1b2f99559bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:28.711241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3662b943-e783-4c4a-9671-b1b2f99559bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:28.711848 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3662b943-e783-4c4a-9671-b1b2f99559bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:28.756106 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-177e1a89-3f4b-4d39-93b9-1ae00889e9f7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:28.764186 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-177e1a89-3f4b-4d39-93b9-1ae00889e9f7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1371 microversion: 2.1 time: 0.156315 Aug 12 06:50:28.765076 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 159/311] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:28 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:28.875342 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3662b943-e783-4c4a-9671-b1b2f99559bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:28.883476 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3662b943-e783-4c4a-9671-b1b2f99559bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.185593 Aug 12 06:50:28.897784 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 153/312] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:28 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:29.444087 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-61d058e2-effb-4c14-bf23-6a73c5497ddc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:29.445604 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-61d058e2-effb-4c14-bf23-6a73c5497ddc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:29.452567 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:29.453939 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:29.462611 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:29.465295 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:29.467336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61d058e2-effb-4c14-bf23-6a73c5497ddc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:29.468035 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61d058e2-effb-4c14-bf23-6a73c5497ddc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:29.468681 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:29.469317 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61d058e2-effb-4c14-bf23-6a73c5497ddc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:29.470257 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:29.471174 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61d058e2-effb-4c14-bf23-6a73c5497ddc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:29.471841 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:29.472481 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61d058e2-effb-4c14-bf23-6a73c5497ddc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:29.473176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:29.473940 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61d058e2-effb-4c14-bf23-6a73c5497ddc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:29.696011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-61d058e2-effb-4c14-bf23-6a73c5497ddc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:29.709152 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:29.713944 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-61d058e2-effb-4c14-bf23-6a73c5497ddc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.272525 Aug 12 06:50:29.716147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 160/313] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:29 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:29.718152 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:29.719891 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:29.721135 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3ddcbd84-a466-4b35-9870-de25eaad20c2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1740 microversion: 2.20 time: 0.272426 Aug 12 06:50:29.723270 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 154/314] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:29 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:29.785217 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ad7d3bf2-66c9-4ea0-b87e-ee26f735107e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:29.786073 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ad7d3bf2-66c9-4ea0-b87e-ee26f735107e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:29.792959 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad7d3bf2-66c9-4ea0-b87e-ee26f735107e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:29.793661 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad7d3bf2-66c9-4ea0-b87e-ee26f735107e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:29.794080 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad7d3bf2-66c9-4ea0-b87e-ee26f735107e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:29.794765 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad7d3bf2-66c9-4ea0-b87e-ee26f735107e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:29.795240 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad7d3bf2-66c9-4ea0-b87e-ee26f735107e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:29.795915 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad7d3bf2-66c9-4ea0-b87e-ee26f735107e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:29.907011 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-336fadee-fbc1-4487-be2b-b942436f2bee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:29.907920 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-336fadee-fbc1-4487-be2b-b942436f2bee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:29.914529 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-336fadee-fbc1-4487-be2b-b942436f2bee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:29.915454 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-336fadee-fbc1-4487-be2b-b942436f2bee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:29.915956 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-336fadee-fbc1-4487-be2b-b942436f2bee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:29.916735 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-336fadee-fbc1-4487-be2b-b942436f2bee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:29.917255 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-336fadee-fbc1-4487-be2b-b942436f2bee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:29.917885 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-336fadee-fbc1-4487-be2b-b942436f2bee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:29.943992 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ad7d3bf2-66c9-4ea0-b87e-ee26f735107e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:29.952250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ad7d3bf2-66c9-4ea0-b87e-ee26f735107e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1371 microversion: 2.1 time: 0.171000 Aug 12 06:50:29.966808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 161/315] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:29 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:30.064419 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-336fadee-fbc1-4487-be2b-b942436f2bee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:30.073022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-336fadee-fbc1-4487-be2b-b942436f2bee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.171141 Aug 12 06:50:30.081218 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 155/316] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:29 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:30.737301 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5872a233-e0fe-4166-bfa5-3d7f39f70c6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:30.738047 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5872a233-e0fe-4166-bfa5-3d7f39f70c6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:30.745970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:30.747166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:30.758966 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5872a233-e0fe-4166-bfa5-3d7f39f70c6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:30.760631 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:30.761332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5872a233-e0fe-4166-bfa5-3d7f39f70c6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:30.761893 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:30.762305 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5872a233-e0fe-4166-bfa5-3d7f39f70c6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:30.762778 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:30.763630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5872a233-e0fe-4166-bfa5-3d7f39f70c6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:30.764360 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:30.765016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5872a233-e0fe-4166-bfa5-3d7f39f70c6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:30.765430 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5872a233-e0fe-4166-bfa5-3d7f39f70c6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:30.768311 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:30.768687 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:30.983893 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:30.985708 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5872a233-e0fe-4166-bfa5-3d7f39f70c6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:30.995554 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5872a233-e0fe-4166-bfa5-3d7f39f70c6c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.262411 Aug 12 06:50:30.996089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 162/317] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:30 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:30.999164 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:31.001687 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:31.003116 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-21923668-70af-4eab-aae1-84250f0cafba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1740 microversion: 2.20 time: 0.261826 Aug 12 06:50:31.007636 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a0cb1593-e937-4003-984d-448106b1b151 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:31.008642 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a0cb1593-e937-4003-984d-448106b1b151 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:31.023468 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 156/318] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:30 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:31.025697 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0cb1593-e937-4003-984d-448106b1b151 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:31.026133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0cb1593-e937-4003-984d-448106b1b151 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:31.026554 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0cb1593-e937-4003-984d-448106b1b151 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:31.027320 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0cb1593-e937-4003-984d-448106b1b151 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:31.027759 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0cb1593-e937-4003-984d-448106b1b151 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:31.028435 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0cb1593-e937-4003-984d-448106b1b151 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:31.031421 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:31.096496 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-837193f2-20f4-446c-b7a9-b06609d29424 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:31.097344 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-837193f2-20f4-446c-b7a9-b06609d29424 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:31.103776 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-837193f2-20f4-446c-b7a9-b06609d29424 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:31.104453 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-837193f2-20f4-446c-b7a9-b06609d29424 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:31.105192 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-837193f2-20f4-446c-b7a9-b06609d29424 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:31.106046 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-837193f2-20f4-446c-b7a9-b06609d29424 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:31.106650 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-837193f2-20f4-446c-b7a9-b06609d29424 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:31.107080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-837193f2-20f4-446c-b7a9-b06609d29424 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:31.220492 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0cb1593-e937-4003-984d-448106b1b151 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:31.229515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a0cb1593-e937-4003-984d-448106b1b151 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1371 microversion: 2.1 time: 0.232386 Aug 12 06:50:31.243152 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 163/319] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:30 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:31.281801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-837193f2-20f4-446c-b7a9-b06609d29424 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:31.292562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-837193f2-20f4-446c-b7a9-b06609d29424 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1367 microversion: 2.1 time: 0.200100 Aug 12 06:50:31.293160 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 157/320] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:31 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:32.020424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9581e99e-5624-4b2a-8297-403bbaa620de tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:32.021373 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9581e99e-5624-4b2a-8297-403bbaa620de tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:32.031298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9581e99e-5624-4b2a-8297-403bbaa620de tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:32.031803 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9581e99e-5624-4b2a-8297-403bbaa620de tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:32.032239 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9581e99e-5624-4b2a-8297-403bbaa620de tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:32.032976 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9581e99e-5624-4b2a-8297-403bbaa620de tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:32.033505 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9581e99e-5624-4b2a-8297-403bbaa620de tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:32.034510 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9581e99e-5624-4b2a-8297-403bbaa620de tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:32.035447 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:32.037155 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:32.051304 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:32.052275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:32.053026 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:32.054470 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:32.055256 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:32.056141 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:32.364343 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:32.375040 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:32.377050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:32.377836 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9581e99e-5624-4b2a-8297-403bbaa620de tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:32.378628 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-29c2e95e-4c36-4000-ac4e-8051480ea8d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1740 microversion: 2.20 time: 0.353922 Aug 12 06:50:32.379859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 158/321] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:32 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1740 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:32.385113 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-1ed3c150-6bb0-4e0e-8e4b-00eeb2441f6e req-b04fa569-2d99-4b26-a1ad-781ebd57fff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1d2c7f-0786-4d54-8a52-d1d3deac1f29", "name": "network-vif-plugged", "status": "completed", "tag": "09e645cd-262e-494b-8463-19e7e2065876"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:32.394903 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1ed3c150-6bb0-4e0e-8e4b-00eeb2441f6e req-b04fa569-2d99-4b26-a1ad-781ebd57fff6 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:32.395703 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1ed3c150-6bb0-4e0e-8e4b-00eeb2441f6e req-b04fa569-2d99-4b26-a1ad-781ebd57fff6 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:32.396737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1ed3c150-6bb0-4e0e-8e4b-00eeb2441f6e req-b04fa569-2d99-4b26-a1ad-781ebd57fff6 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:32.405896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9581e99e-5624-4b2a-8297-403bbaa620de tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.389956 Aug 12 06:50:32.407171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 164/322] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:32 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:32.411994 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-96c8f532-a26c-4263-9b81-6add323517d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:32.412588 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-96c8f532-a26c-4263-9b81-6add323517d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:32.418777 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96c8f532-a26c-4263-9b81-6add323517d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:32.419539 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96c8f532-a26c-4263-9b81-6add323517d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:32.420131 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96c8f532-a26c-4263-9b81-6add323517d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:32.420995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96c8f532-a26c-4263-9b81-6add323517d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:32.421595 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96c8f532-a26c-4263-9b81-6add323517d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:32.422167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96c8f532-a26c-4263-9b81-6add323517d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:32.431286 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-1ed3c150-6bb0-4e0e-8e4b-00eeb2441f6e req-b04fa569-2d99-4b26-a1ad-781ebd57fff6 service nova] Creating event network-vif-plugged:09e645cd-262e-494b-8463-19e7e2065876 for instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 on hv-cinder-84457 Aug 12 06:50:32.437631 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-1ed3c150-6bb0-4e0e-8e4b-00eeb2441f6e req-b04fa569-2d99-4b26-a1ad-781ebd57fff6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056366 Aug 12 06:50:32.441537 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 159/323] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:50:32.449202 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e07fa444-b272-483b-b0ac-18d41604bada tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:32.449999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e07fa444-b272-483b-b0ac-18d41604bada tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:32.456668 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07fa444-b272-483b-b0ac-18d41604bada tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:32.457370 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07fa444-b272-483b-b0ac-18d41604bada tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:32.457795 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07fa444-b272-483b-b0ac-18d41604bada tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:32.458488 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07fa444-b272-483b-b0ac-18d41604bada tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:32.458931 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07fa444-b272-483b-b0ac-18d41604bada tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:32.459369 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07fa444-b272-483b-b0ac-18d41604bada tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:32.669374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-96c8f532-a26c-4263-9b81-6add323517d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:32.682671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-96c8f532-a26c-4263-9b81-6add323517d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1371 microversion: 2.1 time: 0.274147 Aug 12 06:50:32.683739 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 165/324] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:32 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:32.688798 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e07fa444-b272-483b-b0ac-18d41604bada tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:32.700820 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e07fa444-b272-483b-b0ac-18d41604bada tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1558 microversion: 2.1 time: 0.256964 Aug 12 06:50:32.715596 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 160/325] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:32 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1558 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:32.725198 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e4890bbe-fcc5-49be-b64a-53fee645d9c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:32.726139 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e4890bbe-fcc5-49be-b64a-53fee645d9c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:32.732362 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4890bbe-fcc5-49be-b64a-53fee645d9c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:32.733031 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4890bbe-fcc5-49be-b64a-53fee645d9c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:32.733462 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4890bbe-fcc5-49be-b64a-53fee645d9c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:32.734149 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4890bbe-fcc5-49be-b64a-53fee645d9c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:32.734684 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4890bbe-fcc5-49be-b64a-53fee645d9c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:32.735129 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4890bbe-fcc5-49be-b64a-53fee645d9c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:32.832736 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e4890bbe-fcc5-49be-b64a-53fee645d9c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111591 Aug 12 06:50:32.833560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 166/326] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 06:50:32 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:50:33.404273 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:33.405455 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:33.424945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:33.426552 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:33.427323 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:33.428556 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:33.429760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:33.430356 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:33.434661 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-342ab8d0-097f-4ea5-9d04-8fd8a558e626 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:33.437562 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-342ab8d0-097f-4ea5-9d04-8fd8a558e626 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:33.444611 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-342ab8d0-097f-4ea5-9d04-8fd8a558e626 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:33.445417 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-342ab8d0-097f-4ea5-9d04-8fd8a558e626 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:33.446055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-342ab8d0-097f-4ea5-9d04-8fd8a558e626 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:33.447642 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-342ab8d0-097f-4ea5-9d04-8fd8a558e626 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:33.448310 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-342ab8d0-097f-4ea5-9d04-8fd8a558e626 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:33.449202 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-342ab8d0-097f-4ea5-9d04-8fd8a558e626 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:33.706614 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:33.712835 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-342ab8d0-097f-4ea5-9d04-8fd8a558e626 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:33.714970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:33.716506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:33.717665 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cf06131e-66b9-41d9-9f70-0bc6c905baaa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1740 microversion: 2.20 time: 0.319093 Aug 12 06:50:33.733413 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 161/327] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:33 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1740 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:33.738558 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-342ab8d0-097f-4ea5-9d04-8fd8a558e626 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.308551 Aug 12 06:50:33.739552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 167/328] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:33 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:33.740671 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b5a8aa17-5bd9-427c-bffa-3148c091441e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:33.741282 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b5a8aa17-5bd9-427c-bffa-3148c091441e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:33.747331 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b5a8aa17-5bd9-427c-bffa-3148c091441e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:33.747812 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b5a8aa17-5bd9-427c-bffa-3148c091441e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:33.748237 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b5a8aa17-5bd9-427c-bffa-3148c091441e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:33.748930 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b5a8aa17-5bd9-427c-bffa-3148c091441e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:33.749380 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b5a8aa17-5bd9-427c-bffa-3148c091441e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:33.750115 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b5a8aa17-5bd9-427c-bffa-3148c091441e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:33.858126 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-1217ca6c-a529-4547-92b0-c842b27c2f07 req-50147d35-e574-436b-9638-ee98c127a548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205712a3-060e-4c1a-a2c2-dd9130af8577", "tag": "60906462-e7fb-48a2-911f-43a5cce62879"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:33.868924 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1217ca6c-a529-4547-92b0-c842b27c2f07 req-50147d35-e574-436b-9638-ee98c127a548 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:33.869560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1217ca6c-a529-4547-92b0-c842b27c2f07 req-50147d35-e574-436b-9638-ee98c127a548 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:33.869985 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1217ca6c-a529-4547-92b0-c842b27c2f07 req-50147d35-e574-436b-9638-ee98c127a548 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:33.882742 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-1217ca6c-a529-4547-92b0-c842b27c2f07 req-50147d35-e574-436b-9638-ee98c127a548 service nova] Creating event network-changed:60906462-e7fb-48a2-911f-43a5cce62879 for instance 205712a3-060e-4c1a-a2c2-dd9130af8577 on hv-cinder-84457 Aug 12 06:50:33.888060 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-1217ca6c-a529-4547-92b0-c842b27c2f07 req-50147d35-e574-436b-9638-ee98c127a548 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034082 Aug 12 06:50:33.889106 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 168/329] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:50:33.954948 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b5a8aa17-5bd9-427c-bffa-3148c091441e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:33.962750 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b5a8aa17-5bd9-427c-bffa-3148c091441e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1371 microversion: 2.1 time: 0.242770 Aug 12 06:50:33.963325 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 162/330] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:33 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:34.741943 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:34.742771 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:34.753465 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:34.754147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:34.754750 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:34.755504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:34.755985 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:34.756488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:34.761676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6daf6556-5c75-4491-bbc7-66b244c29768 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:34.762331 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6daf6556-5c75-4491-bbc7-66b244c29768 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:34.769919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6daf6556-5c75-4491-bbc7-66b244c29768 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:34.770507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6daf6556-5c75-4491-bbc7-66b244c29768 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:34.771438 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6daf6556-5c75-4491-bbc7-66b244c29768 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:34.772408 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6daf6556-5c75-4491-bbc7-66b244c29768 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:34.773070 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6daf6556-5c75-4491-bbc7-66b244c29768 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:34.773707 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6daf6556-5c75-4491-bbc7-66b244c29768 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:34.985797 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:34.996534 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6daf6556-5c75-4491-bbc7-66b244c29768 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:34.996702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:34.998236 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:34.999794 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-891eddfc-f6a0-4413-a06f-7331af729b87 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1722 microversion: 2.20 time: 0.262329 Aug 12 06:50:35.000433 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 169/331] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:34 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:35.020671 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6daf6556-5c75-4491-bbc7-66b244c29768 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.262748 Aug 12 06:50:35.021565 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 163/332] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:34 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:35.022656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-321504c7-4c9e-4114-bb26-31d798652bd6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:35.023382 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-321504c7-4c9e-4114-bb26-31d798652bd6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:35.029879 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-321504c7-4c9e-4114-bb26-31d798652bd6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:35.030441 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-321504c7-4c9e-4114-bb26-31d798652bd6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:35.031092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-321504c7-4c9e-4114-bb26-31d798652bd6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:35.031862 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-321504c7-4c9e-4114-bb26-31d798652bd6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:35.032408 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-321504c7-4c9e-4114-bb26-31d798652bd6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:35.033004 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-321504c7-4c9e-4114-bb26-31d798652bd6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:35.356990 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-321504c7-4c9e-4114-bb26-31d798652bd6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:35.365474 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-321504c7-4c9e-4114-bb26-31d798652bd6 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1564 microversion: 2.1 time: 0.352704 Aug 12 06:50:35.366050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 170/333] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:35 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1564 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:35.386049 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5013d0c9-7305-499c-addd-5b8027c1fc5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:35.386538 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5013d0c9-7305-499c-addd-5b8027c1fc5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:35.392721 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5013d0c9-7305-499c-addd-5b8027c1fc5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:35.393203 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5013d0c9-7305-499c-addd-5b8027c1fc5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:35.393820 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5013d0c9-7305-499c-addd-5b8027c1fc5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:35.394792 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5013d0c9-7305-499c-addd-5b8027c1fc5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:35.395276 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5013d0c9-7305-499c-addd-5b8027c1fc5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:35.395692 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5013d0c9-7305-499c-addd-5b8027c1fc5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:35.551484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5013d0c9-7305-499c-addd-5b8027c1fc5f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169253 Aug 12 06:50:35.559057 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 164/334] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 06:50:35 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:50:36.035947 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:36.036773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:36.046466 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-aac0b059-d839-4c3e-b2d9-25f6a8f613b8 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:36.047115 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-aac0b059-d839-4c3e-b2d9-25f6a8f613b8 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:36.058783 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:36.059289 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:36.059715 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:36.060409 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:36.063238 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aac0b059-d839-4c3e-b2d9-25f6a8f613b8 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:36.063717 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aac0b059-d839-4c3e-b2d9-25f6a8f613b8 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:36.064136 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aac0b059-d839-4c3e-b2d9-25f6a8f613b8 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:36.064865 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aac0b059-d839-4c3e-b2d9-25f6a8f613b8 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:36.065740 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aac0b059-d839-4c3e-b2d9-25f6a8f613b8 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:36.065740 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aac0b059-d839-4c3e-b2d9-25f6a8f613b8 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:36.069944 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:36.070456 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:36.281171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:36.281978 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-aac0b059-d839-4c3e-b2d9-25f6a8f613b8 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:36.290546 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-aac0b059-d839-4c3e-b2d9-25f6a8f613b8 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.250603 Aug 12 06:50:36.291363 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 165/335] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:36 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:36.300271 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:36.305962 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:36.307179 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bda1d601-4fc1-4cb7-a2ed-a03313760159 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1722 microversion: 2.20 time: 0.283196 Aug 12 06:50:36.307747 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 171/336] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:36 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:36.560483 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-dc1f2ef3-8f3a-4212-a71b-1b0fc84d67f0 req-2eb27c30-13c8-491f-a48b-e951472526a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1d2c7f-0786-4d54-8a52-d1d3deac1f29", "tag": "09e645cd-262e-494b-8463-19e7e2065876"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:36.578327 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-dc1f2ef3-8f3a-4212-a71b-1b0fc84d67f0 req-2eb27c30-13c8-491f-a48b-e951472526a2 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:36.579201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-dc1f2ef3-8f3a-4212-a71b-1b0fc84d67f0 req-2eb27c30-13c8-491f-a48b-e951472526a2 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:36.579837 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-dc1f2ef3-8f3a-4212-a71b-1b0fc84d67f0 req-2eb27c30-13c8-491f-a48b-e951472526a2 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:36.591637 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-dc1f2ef3-8f3a-4212-a71b-1b0fc84d67f0 req-2eb27c30-13c8-491f-a48b-e951472526a2 service nova] Creating event network-changed:09e645cd-262e-494b-8463-19e7e2065876 for instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 on hv-cinder-84457 Aug 12 06:50:36.597606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-dc1f2ef3-8f3a-4212-a71b-1b0fc84d67f0 req-2eb27c30-13c8-491f-a48b-e951472526a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041258 Aug 12 06:50:36.598281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 166/337] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:50:37.313332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-80c0f1cd-9aed-446f-97de-66f1bb7df6b9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:37.314025 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-80c0f1cd-9aed-446f-97de-66f1bb7df6b9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:37.320334 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80c0f1cd-9aed-446f-97de-66f1bb7df6b9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:37.320864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80c0f1cd-9aed-446f-97de-66f1bb7df6b9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:37.321353 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80c0f1cd-9aed-446f-97de-66f1bb7df6b9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:37.322043 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80c0f1cd-9aed-446f-97de-66f1bb7df6b9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:37.322498 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80c0f1cd-9aed-446f-97de-66f1bb7df6b9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:37.322907 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80c0f1cd-9aed-446f-97de-66f1bb7df6b9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:37.331683 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:37.332383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:37.340675 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:37.341324 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:37.342588 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:37.343353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:37.343814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:37.344276 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:37.521959 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-80c0f1cd-9aed-446f-97de-66f1bb7df6b9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:37.530501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-80c0f1cd-9aed-446f-97de-66f1bb7df6b9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.222233 Aug 12 06:50:37.531683 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 172/338] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:37 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:37.551776 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:37.559865 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:37.561424 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:37.562578 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0f009001-ff2b-4063-9b33-1f87d9137d8e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1722 microversion: 2.20 time: 0.236384 Aug 12 06:50:37.563170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 167/339] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:37 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:38.279698 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-7b61d7e6-e382-4958-9693-c8d4f338e09b req-69a2fa38-6061-491c-a4e6-b0a1dd9f18f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bc12e0-d758-47a7-920d-971a6e993711", "name": "network-vif-unplugged", "status": "completed", "tag": "2de31bfc-bbcb-4a81-989c-adfbe72a2aac"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:38.289356 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:38.292211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-7b61d7e6-e382-4958-9693-c8d4f338e09b req-69a2fa38-6061-491c-a4e6-b0a1dd9f18f8 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:38.294058 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-7b61d7e6-e382-4958-9693-c8d4f338e09b req-69a2fa38-6061-491c-a4e6-b0a1dd9f18f8 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:38.294795 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-7b61d7e6-e382-4958-9693-c8d4f338e09b req-69a2fa38-6061-491c-a4e6-b0a1dd9f18f8 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:38.308829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.compute.server_external_events [req-7b61d7e6-e382-4958-9693-c8d4f338e09b req-69a2fa38-6061-491c-a4e6-b0a1dd9f18f8 service nova] Unable to find a host for instance a6bc12e0-d758-47a7-920d-971a6e993711. Dropping event network-vif-unplugged {{(pid=127088) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 12 06:50:38.309824 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-7b61d7e6-e382-4958-9693-c8d4f338e09b req-69a2fa38-6061-491c-a4e6-b0a1dd9f18f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033939 Aug 12 06:50:38.310479 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 173/340] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 12 06:50:38.552536 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a94003d7-bbae-4144-8bf7-ead63772ee69 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:38.553087 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a94003d7-bbae-4144-8bf7-ead63772ee69 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:38.560180 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a94003d7-bbae-4144-8bf7-ead63772ee69 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:38.560672 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a94003d7-bbae-4144-8bf7-ead63772ee69 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:38.561100 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a94003d7-bbae-4144-8bf7-ead63772ee69 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:38.561806 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a94003d7-bbae-4144-8bf7-ead63772ee69 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:38.562258 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a94003d7-bbae-4144-8bf7-ead63772ee69 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:38.562680 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a94003d7-bbae-4144-8bf7-ead63772ee69 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:38.585544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:38.586279 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:38.594422 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:38.594905 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:38.595741 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:38.596047 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:38.596467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:38.596882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:38.850192 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a94003d7-bbae-4144-8bf7-ead63772ee69 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:38.855093 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:38.858506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a94003d7-bbae-4144-8bf7-ead63772ee69 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.310013 Aug 12 06:50:38.859142 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 168/341] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:38 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:38.863629 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:38.865133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:38.866314 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1464de3e-9769-4186-98f6-82923ca21802 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1665 microversion: 2.20 time: 0.284715 Aug 12 06:50:38.866861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 174/342] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:38 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1665 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:38.888946 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-eb29dfcf-13a7-4f02-912f-1ad0c9defbd8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "022995e5-d9b0-4b88-91a2-0e18d70ff8b7"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:38.891564 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-eb29dfcf-13a7-4f02-912f-1ad0c9defbd8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:38.897815 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb29dfcf-13a7-4f02-912f-1ad0c9defbd8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:38.898411 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb29dfcf-13a7-4f02-912f-1ad0c9defbd8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:38.898843 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb29dfcf-13a7-4f02-912f-1ad0c9defbd8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:38.899563 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb29dfcf-13a7-4f02-912f-1ad0c9defbd8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:38.900013 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb29dfcf-13a7-4f02-912f-1ad0c9defbd8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:38.900430 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb29dfcf-13a7-4f02-912f-1ad0c9defbd8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:38.917973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:39.195085 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-eb29dfcf-13a7-4f02-912f-1ad0c9defbd8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "POST /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.310040 Aug 12 06:50:39.195823 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 169/343] 10.222.0.20 () {62 vars in 1364 bytes} [Fri Aug 12 06:50:38 2022] POST /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:50:39.320001 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9fd6cba9-2757-4ef2-81f3-dfb873ad6c1d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:39.321066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9fd6cba9-2757-4ef2-81f3-dfb873ad6c1d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:39.328195 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fd6cba9-2757-4ef2-81f3-dfb873ad6c1d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:39.328674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fd6cba9-2757-4ef2-81f3-dfb873ad6c1d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:39.329094 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fd6cba9-2757-4ef2-81f3-dfb873ad6c1d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:39.329949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fd6cba9-2757-4ef2-81f3-dfb873ad6c1d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:39.330433 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fd6cba9-2757-4ef2-81f3-dfb873ad6c1d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:39.330829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fd6cba9-2757-4ef2-81f3-dfb873ad6c1d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:39.373477 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9fd6cba9-2757-4ef2-81f3-dfb873ad6c1d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127088) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 06:50:39.440742 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9fd6cba9-2757-4ef2-81f3-dfb873ad6c1d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "POST /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/action" status: 202 len: 0 microversion: 2.20 time: 0.124705 Aug 12 06:50:39.441777 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 175/344] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Aug 12 06:50:39 2022] POST /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:50:39.451210 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:39.451210 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:39.457831 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:39.458312 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:39.458768 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:39.459483 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:39.459933 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:39.460345 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:39.603681 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:39.612365 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:39.614031 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:39.615894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-32d1adf3-1d42-4324-aeb0-cbf49107ed13 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1751 microversion: 2.20 time: 0.169711 Aug 12 06:50:39.617015 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 170/345] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:39 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:39.880513 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0a53b803-6f01-4355-a6ea-3c8f331cf281 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:39.882118 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0a53b803-6f01-4355-a6ea-3c8f331cf281 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:39.889394 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a53b803-6f01-4355-a6ea-3c8f331cf281 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:39.889877 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a53b803-6f01-4355-a6ea-3c8f331cf281 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:39.890304 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a53b803-6f01-4355-a6ea-3c8f331cf281 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:39.891069 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a53b803-6f01-4355-a6ea-3c8f331cf281 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:39.891800 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a53b803-6f01-4355-a6ea-3c8f331cf281 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:39.892204 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a53b803-6f01-4355-a6ea-3c8f331cf281 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:40.048059 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0a53b803-6f01-4355-a6ea-3c8f331cf281 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:40.059450 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0a53b803-6f01-4355-a6ea-3c8f331cf281 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.183903 Aug 12 06:50:40.059953 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 176/346] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:39 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:40.647484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:40.648078 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:40.654138 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:40.654629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:40.655061 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:40.655795 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:40.656179 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:40.656589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:40.794243 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:40.802801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:40.804339 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:40.805511 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-801a17c4-d136-4cd8-b91f-d34f0577af5e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1753 microversion: 2.20 time: 0.163049 Aug 12 06:50:40.806049 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 171/347] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:40 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:41.085001 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e8d3d7b5-dc68-4c57-b9af-943e9e0e8431 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:41.086074 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e8d3d7b5-dc68-4c57-b9af-943e9e0e8431 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:41.096542 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8d3d7b5-dc68-4c57-b9af-943e9e0e8431 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:41.097347 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8d3d7b5-dc68-4c57-b9af-943e9e0e8431 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:41.098057 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8d3d7b5-dc68-4c57-b9af-943e9e0e8431 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:41.099241 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8d3d7b5-dc68-4c57-b9af-943e9e0e8431 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:41.100032 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8d3d7b5-dc68-4c57-b9af-943e9e0e8431 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:41.100727 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8d3d7b5-dc68-4c57-b9af-943e9e0e8431 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:41.236999 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e8d3d7b5-dc68-4c57-b9af-943e9e0e8431 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:41.245351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e8d3d7b5-dc68-4c57-b9af-943e9e0e8431 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.166960 Aug 12 06:50:41.246000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 177/348] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:41 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:41.829818 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:41.830472 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:41.836891 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:41.837363 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:41.837775 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:41.838459 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:41.839357 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:41.839797 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:42.008069 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:42.017382 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:42.018864 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:42.020122 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9ead7e17-9187-41bf-aa6f-10a15d307660 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.194418 Aug 12 06:50:42.030998 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 172/349] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:41 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:42.269106 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3cf86a9b-71c9-4ba2-948f-ac578d5ed67c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:42.269854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3cf86a9b-71c9-4ba2-948f-ac578d5ed67c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:42.276150 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cf86a9b-71c9-4ba2-948f-ac578d5ed67c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:42.276618 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cf86a9b-71c9-4ba2-948f-ac578d5ed67c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:42.277039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cf86a9b-71c9-4ba2-948f-ac578d5ed67c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:42.277719 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cf86a9b-71c9-4ba2-948f-ac578d5ed67c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:42.278327 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cf86a9b-71c9-4ba2-948f-ac578d5ed67c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:42.278736 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cf86a9b-71c9-4ba2-948f-ac578d5ed67c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:42.483782 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3cf86a9b-71c9-4ba2-948f-ac578d5ed67c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:42.492265 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3cf86a9b-71c9-4ba2-948f-ac578d5ed67c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.227635 Aug 12 06:50:42.493519 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 178/350] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:42 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:43.044457 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:43.045053 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:43.051559 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:43.052037 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:43.052629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:43.053318 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:43.053766 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:43.054185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:43.191179 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:43.199801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:43.201839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:43.203037 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-668448d7-3eb2-4f56-8886-35152ddae3e3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.162466 Aug 12 06:50:43.203592 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 173/351] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:43 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:43.518801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c4477632-88db-4417-a769-f79fa2ebc339 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:43.521674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c4477632-88db-4417-a769-f79fa2ebc339 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:43.538514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4477632-88db-4417-a769-f79fa2ebc339 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:43.539285 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4477632-88db-4417-a769-f79fa2ebc339 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:43.539950 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4477632-88db-4417-a769-f79fa2ebc339 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:43.540802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4477632-88db-4417-a769-f79fa2ebc339 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:43.541402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4477632-88db-4417-a769-f79fa2ebc339 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:43.541971 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4477632-88db-4417-a769-f79fa2ebc339 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:43.833417 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c4477632-88db-4417-a769-f79fa2ebc339 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:43.844521 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c4477632-88db-4417-a769-f79fa2ebc339 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.329403 Aug 12 06:50:43.845701 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 179/352] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:43 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:44.226024 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:44.226887 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:44.234302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:44.234787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:44.235267 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:44.235965 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:44.236432 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:44.236848 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:44.372174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:44.381194 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:44.382902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:44.384172 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fb24975d-7d80-486e-b5d6-74f42cb86092 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.162342 Aug 12 06:50:44.384734 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 174/353] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:44 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:44.866629 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2209a16f-e16f-4fd9-9c90-92f5b19c69bc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:44.867220 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2209a16f-e16f-4fd9-9c90-92f5b19c69bc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:44.873600 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2209a16f-e16f-4fd9-9c90-92f5b19c69bc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:44.874281 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2209a16f-e16f-4fd9-9c90-92f5b19c69bc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:44.874930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2209a16f-e16f-4fd9-9c90-92f5b19c69bc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:44.875658 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2209a16f-e16f-4fd9-9c90-92f5b19c69bc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:44.876109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2209a16f-e16f-4fd9-9c90-92f5b19c69bc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:44.876524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2209a16f-e16f-4fd9-9c90-92f5b19c69bc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:44.891900 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:45.024160 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2209a16f-e16f-4fd9-9c90-92f5b19c69bc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:45.038576 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2209a16f-e16f-4fd9-9c90-92f5b19c69bc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.170780 Aug 12 06:50:45.052075 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 180/354] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:44 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:45.412860 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:45.413469 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:45.424347 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:45.424830 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:45.425313 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:45.426013 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:45.426460 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:45.426884 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:45.598210 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:45.607894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:45.618667 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:45.620677 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0ac11ee4-6e58-4f26-8595-d790a9295c4d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.217105 Aug 12 06:50:45.638306 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 175/355] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:45 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:46.059878 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2665be2d-0cfd-44b4-8f2f-c669cd85e233 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:46.060566 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2665be2d-0cfd-44b4-8f2f-c669cd85e233 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:46.066940 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2665be2d-0cfd-44b4-8f2f-c669cd85e233 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:46.079869 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2665be2d-0cfd-44b4-8f2f-c669cd85e233 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:46.080355 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2665be2d-0cfd-44b4-8f2f-c669cd85e233 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:46.081133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2665be2d-0cfd-44b4-8f2f-c669cd85e233 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:46.081590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2665be2d-0cfd-44b4-8f2f-c669cd85e233 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:46.081999 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2665be2d-0cfd-44b4-8f2f-c669cd85e233 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:46.236636 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2665be2d-0cfd-44b4-8f2f-c669cd85e233 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:46.245401 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2665be2d-0cfd-44b4-8f2f-c669cd85e233 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.189389 Aug 12 06:50:46.246015 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 181/356] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:46 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:46.644929 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:46.645508 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:46.653773 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:46.654347 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:46.654746 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:46.655684 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:46.656140 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:46.656560 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:46.796185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:46.809634 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:46.811208 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:46.812647 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-590c623e-b14d-4bb0-82b6-fb44a3d0f6d0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.171549 Aug 12 06:50:46.813197 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 176/357] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:46 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:47.265895 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-62489c02-0348-48bb-ab5c-7251b027f8f6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:47.266487 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-62489c02-0348-48bb-ab5c-7251b027f8f6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:47.273770 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62489c02-0348-48bb-ab5c-7251b027f8f6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:47.274250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62489c02-0348-48bb-ab5c-7251b027f8f6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:47.274670 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62489c02-0348-48bb-ab5c-7251b027f8f6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:47.275378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62489c02-0348-48bb-ab5c-7251b027f8f6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:47.275822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62489c02-0348-48bb-ab5c-7251b027f8f6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:47.276235 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62489c02-0348-48bb-ab5c-7251b027f8f6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:47.464548 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-62489c02-0348-48bb-ab5c-7251b027f8f6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:47.474103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-62489c02-0348-48bb-ab5c-7251b027f8f6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.211985 Aug 12 06:50:47.474790 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 182/358] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:47 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:47.836641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:47.837258 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:47.844667 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:47.845428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:47.846032 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:47.846928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:47.847601 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:47.848194 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:48.092008 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:48.101270 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:48.102804 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:48.103963 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9d331778-8655-4d71-8484-0b5c623d3c40 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.271285 Aug 12 06:50:48.104520 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 177/359] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:47 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:50:48.496892 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-31d1636f-16bb-4e4e-bbff-6f1539d6dade tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:48.497487 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-31d1636f-16bb-4e4e-bbff-6f1539d6dade tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:48.508079 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d1636f-16bb-4e4e-bbff-6f1539d6dade tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:48.508846 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d1636f-16bb-4e4e-bbff-6f1539d6dade tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:48.509477 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d1636f-16bb-4e4e-bbff-6f1539d6dade tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:48.510181 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d1636f-16bb-4e4e-bbff-6f1539d6dade tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:48.510604 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d1636f-16bb-4e4e-bbff-6f1539d6dade tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:48.511079 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d1636f-16bb-4e4e-bbff-6f1539d6dade tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:48.665686 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-31d1636f-16bb-4e4e-bbff-6f1539d6dade tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:48.675268 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-31d1636f-16bb-4e4e-bbff-6f1539d6dade tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.181918 Aug 12 06:50:48.676105 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 183/360] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:48 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:49.129496 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:49.130345 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:49.139562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:49.140412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:49.141067 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:49.142101 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:49.143044 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:49.143637 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:49.321418 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:49.336199 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:49.338247 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:49.340037 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0b5a138e-a451-4527-be48-5fd9c5a5db90 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.215071 Aug 12 06:50:49.357390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 178/361] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:49 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:49.697232 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-af57e242-d190-4a89-a947-03382154a4ce tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:49.698476 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-af57e242-d190-4a89-a947-03382154a4ce tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:49.704813 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af57e242-d190-4a89-a947-03382154a4ce tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:49.705257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af57e242-d190-4a89-a947-03382154a4ce tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:49.705849 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af57e242-d190-4a89-a947-03382154a4ce tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:49.706697 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af57e242-d190-4a89-a947-03382154a4ce tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:49.720958 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af57e242-d190-4a89-a947-03382154a4ce tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:49.721628 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af57e242-d190-4a89-a947-03382154a4ce tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:49.909659 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af57e242-d190-4a89-a947-03382154a4ce tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:49.920624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-af57e242-d190-4a89-a947-03382154a4ce tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.226961 Aug 12 06:50:49.921862 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 184/362] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:49 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:50:50.364111 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:50.364764 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:50.371320 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:50.371804 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:50.372227 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:50.372902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:50.373351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:50.373746 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:50.508791 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:50.519265 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:50.520768 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:50.522256 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-46a65823-20ee-476c-874d-bcf33b54c963 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.162155 Aug 12 06:50:50.523009 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 179/363] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:50 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:50.944056 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-aadac2fc-3cf8-48bc-91b4-e658b3c09acc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:50.944654 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-aadac2fc-3cf8-48bc-91b4-e658b3c09acc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:50.951063 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadac2fc-3cf8-48bc-91b4-e658b3c09acc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:50.951555 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadac2fc-3cf8-48bc-91b4-e658b3c09acc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:50.952293 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadac2fc-3cf8-48bc-91b4-e658b3c09acc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:50.952984 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadac2fc-3cf8-48bc-91b4-e658b3c09acc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:50.953434 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadac2fc-3cf8-48bc-91b4-e658b3c09acc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:50.953854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadac2fc-3cf8-48bc-91b4-e658b3c09acc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:50.956812 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-819011648", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "networks": [{"uuid": "047a5092-c563-46a3-97a5-2942955cfb18"}]}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:51.018679 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] validate_networks() for [('047a5092-c563-46a3-97a5-2942955cfb18', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:50:51.181681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aadac2fc-3cf8-48bc-91b4-e658b3c09acc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:51.190525 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-aadac2fc-3cf8-48bc-91b4-e658b3c09acc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.250144 Aug 12 06:50:51.191155 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 185/364] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:50 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:51.426486 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:50:51.427015 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:50:51.427399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:50:51.427816 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:50:51.428219 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:50:51.438195 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:51.438679 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:51.439321 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:51.440228 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:51.440683 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:51.441105 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:51.458034 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Getting quotas for project 7de24610a31e4f65908ac9f4ca56cbae. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:50:51.462061 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Getting quotas for user c84dd7d7aec747b482cadf308411ea61 and project 7de24610a31e4f65908ac9f4ca56cbae. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:50:51.472950 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:50:51.475284 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:50:51.525144 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8fea133e-4c8e-4486-bcb2-6366e8e3f1ff tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572090 Aug 12 06:50:51.525796 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 180/365] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:50:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 06:50:51.536420 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-57f8f82e-ece7-4851-92d6-4a2ccf35f5a7 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:51.537274 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-57f8f82e-ece7-4851-92d6-4a2ccf35f5a7 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:51.546404 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:51.547500 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:51.558438 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:51.559196 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:51.559914 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:51.561478 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:51.562018 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:51.562488 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:51.613047 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-57f8f82e-ece7-4851-92d6-4a2ccf35f5a7 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:51.621428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-57f8f82e-ece7-4851-92d6-4a2ccf35f5a7 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1218 microversion: 2.1 time: 0.087276 Aug 12 06:50:51.622361 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 186/366] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:51 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:51.736333 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:51.745940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:51.747461 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:51.748626 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7b93ea26-c18c-47fa-bf9a-c288018a5662 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.206348 Aug 12 06:50:51.749183 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 181/367] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:51 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:52.214667 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d25b090b-3133-4f2c-a953-5f543cb05f1b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:52.215407 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d25b090b-3133-4f2c-a953-5f543cb05f1b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:52.222382 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25b090b-3133-4f2c-a953-5f543cb05f1b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:52.222871 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25b090b-3133-4f2c-a953-5f543cb05f1b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:52.223320 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25b090b-3133-4f2c-a953-5f543cb05f1b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:52.224008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25b090b-3133-4f2c-a953-5f543cb05f1b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:52.224424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25b090b-3133-4f2c-a953-5f543cb05f1b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:52.224860 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25b090b-3133-4f2c-a953-5f543cb05f1b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:52.370199 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d25b090b-3133-4f2c-a953-5f543cb05f1b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:52.379314 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d25b090b-3133-4f2c-a953-5f543cb05f1b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.169382 Aug 12 06:50:52.379886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 187/368] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:52 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:52.643465 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0772578e-5941-4506-bb37-cb9d9ccc2ae4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:52.644098 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0772578e-5941-4506-bb37-cb9d9ccc2ae4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:52.651528 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0772578e-5941-4506-bb37-cb9d9ccc2ae4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:52.652014 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0772578e-5941-4506-bb37-cb9d9ccc2ae4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:52.652470 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0772578e-5941-4506-bb37-cb9d9ccc2ae4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:52.653198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0772578e-5941-4506-bb37-cb9d9ccc2ae4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:52.653817 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0772578e-5941-4506-bb37-cb9d9ccc2ae4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:52.654387 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0772578e-5941-4506-bb37-cb9d9ccc2ae4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:52.719321 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0772578e-5941-4506-bb37-cb9d9ccc2ae4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:52.728448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0772578e-5941-4506-bb37-cb9d9ccc2ae4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1222 microversion: 2.1 time: 0.089889 Aug 12 06:50:52.731194 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 182/369] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:52 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:52.772542 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:52.773140 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:52.779993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:52.780474 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:52.781090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:52.781970 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:52.782427 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:52.783126 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:52.930746 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:52.940423 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:52.941909 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:52.943139 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-31d67552-6ea0-4a36-b3dd-4c4a6fda4781 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.174953 Aug 12 06:50:52.943698 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 188/370] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:52 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:53.405972 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5c5aac70-f739-4488-98df-6efd13f7b43d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:53.406849 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5c5aac70-f739-4488-98df-6efd13f7b43d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:53.409746 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:53.417267 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5c5aac70-f739-4488-98df-6efd13f7b43d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:53.417758 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5c5aac70-f739-4488-98df-6efd13f7b43d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:53.418453 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5c5aac70-f739-4488-98df-6efd13f7b43d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:53.418866 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5c5aac70-f739-4488-98df-6efd13f7b43d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:53.419409 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5c5aac70-f739-4488-98df-6efd13f7b43d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:53.419838 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5c5aac70-f739-4488-98df-6efd13f7b43d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:53.555376 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5c5aac70-f739-4488-98df-6efd13f7b43d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:53.564048 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5c5aac70-f739-4488-98df-6efd13f7b43d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1722 microversion: 2.1 time: 0.164621 Aug 12 06:50:53.564625 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 183/371] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:53 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:53.749711 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2be27bd5-ee89-4a2d-9fbb-8b556b038c2e tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:53.750300 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2be27bd5-ee89-4a2d-9fbb-8b556b038c2e tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:53.756398 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2be27bd5-ee89-4a2d-9fbb-8b556b038c2e tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:53.756909 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2be27bd5-ee89-4a2d-9fbb-8b556b038c2e tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:53.757336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2be27bd5-ee89-4a2d-9fbb-8b556b038c2e tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:53.758020 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2be27bd5-ee89-4a2d-9fbb-8b556b038c2e tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:53.758467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2be27bd5-ee89-4a2d-9fbb-8b556b038c2e tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:53.758883 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2be27bd5-ee89-4a2d-9fbb-8b556b038c2e tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:53.830318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2be27bd5-ee89-4a2d-9fbb-8b556b038c2e tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:53.838012 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2be27bd5-ee89-4a2d-9fbb-8b556b038c2e tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1222 microversion: 2.1 time: 0.092571 Aug 12 06:50:53.838577 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 189/372] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:53 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:53.966831 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:53.967473 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:53.974123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:53.974607 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:53.975056 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:53.975760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:53.976189 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:53.976602 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:53.980516 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:50:54.109738 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:54.119062 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:54.121480 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:54.123209 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-690ebc7f-2883-4965-8f5e-d907e7f39870 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.160470 Aug 12 06:50:54.123956 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 184/373] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:53 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:50:54.589174 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-98b707b0-3646-46e5-a776-51a6a9f466ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:54.590159 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-98b707b0-3646-46e5-a776-51a6a9f466ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:54.600250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98b707b0-3646-46e5-a776-51a6a9f466ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:54.601079 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98b707b0-3646-46e5-a776-51a6a9f466ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:54.601851 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98b707b0-3646-46e5-a776-51a6a9f466ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:54.602563 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98b707b0-3646-46e5-a776-51a6a9f466ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:54.603017 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98b707b0-3646-46e5-a776-51a6a9f466ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:54.603448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98b707b0-3646-46e5-a776-51a6a9f466ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:54.739349 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-98b707b0-3646-46e5-a776-51a6a9f466ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:54.751512 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-98b707b0-3646-46e5-a776-51a6a9f466ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1699 microversion: 2.1 time: 0.168579 Aug 12 06:50:54.752104 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 190/374] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:54 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1699 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:54.774219 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bd937943-4f49-4ac0-a3dc-bcb83b49607b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:54.780930 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd937943-4f49-4ac0-a3dc-bcb83b49607b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:54.781418 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd937943-4f49-4ac0-a3dc-bcb83b49607b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:54.781858 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd937943-4f49-4ac0-a3dc-bcb83b49607b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:54.843890 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bd937943-4f49-4ac0-a3dc-bcb83b49607b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Going to try to start instance {{(pid=127087) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 12 06:50:54.859015 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-73c798b4-1311-40fb-a28d-a8548b6611b2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:54.859638 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-73c798b4-1311-40fb-a28d-a8548b6611b2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:54.865873 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73c798b4-1311-40fb-a28d-a8548b6611b2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:54.866356 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73c798b4-1311-40fb-a28d-a8548b6611b2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:54.866781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73c798b4-1311-40fb-a28d-a8548b6611b2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:54.867536 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73c798b4-1311-40fb-a28d-a8548b6611b2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:54.867979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73c798b4-1311-40fb-a28d-a8548b6611b2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:54.868394 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73c798b4-1311-40fb-a28d-a8548b6611b2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:54.891751 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bd937943-4f49-4ac0-a3dc-bcb83b49607b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "POST /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/action" status: 202 len: 0 microversion: 2.1 time: 0.121537 Aug 12 06:50:54.892325 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 185/375] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:50:54 2022] POST /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:50:54.900901 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5542d9f3-67e7-4a93-81cf-736241f8502c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:54.901591 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5542d9f3-67e7-4a93-81cf-736241f8502c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:54.907782 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5542d9f3-67e7-4a93-81cf-736241f8502c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:54.908260 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5542d9f3-67e7-4a93-81cf-736241f8502c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:54.908691 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5542d9f3-67e7-4a93-81cf-736241f8502c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:54.909368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5542d9f3-67e7-4a93-81cf-736241f8502c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:54.909815 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5542d9f3-67e7-4a93-81cf-736241f8502c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:54.910228 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5542d9f3-67e7-4a93-81cf-736241f8502c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:54.938422 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-73c798b4-1311-40fb-a28d-a8548b6611b2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:54.947349 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-73c798b4-1311-40fb-a28d-a8548b6611b2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1214 microversion: 2.1 time: 0.091807 Aug 12 06:50:54.948692 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 191/376] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:54 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:55.050616 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5542d9f3-67e7-4a93-81cf-736241f8502c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:55.059407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5542d9f3-67e7-4a93-81cf-736241f8502c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1708 microversion: 2.1 time: 0.162302 Aug 12 06:50:55.059972 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 186/377] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:54 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:55.150573 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:55.151208 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:55.157542 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:55.158101 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:55.159136 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:55.160244 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:55.160696 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:55.161105 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:55.334500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:55.343607 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:55.345084 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:55.346231 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5f290eea-618d-4033-89bc-170279505ebb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.200182 Aug 12 06:50:55.346788 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 192/378] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:55 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:55.971503 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-918ca8f4-9194-4f5f-923d-d3696f7c0c5b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:55.972083 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-918ca8f4-9194-4f5f-923d-d3696f7c0c5b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:55.979008 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-918ca8f4-9194-4f5f-923d-d3696f7c0c5b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:55.979531 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-918ca8f4-9194-4f5f-923d-d3696f7c0c5b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:55.979957 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-918ca8f4-9194-4f5f-923d-d3696f7c0c5b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:55.980635 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-918ca8f4-9194-4f5f-923d-d3696f7c0c5b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:55.981084 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-918ca8f4-9194-4f5f-923d-d3696f7c0c5b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:55.981502 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-918ca8f4-9194-4f5f-923d-d3696f7c0c5b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:56.059635 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-918ca8f4-9194-4f5f-923d-d3696f7c0c5b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:56.068066 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-918ca8f4-9194-4f5f-923d-d3696f7c0c5b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1270 microversion: 2.1 time: 0.101923 Aug 12 06:50:56.068628 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 187/379] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:55 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:56.081741 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-95a5982b-5744-49cd-9f50-71288ea58801 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:56.082530 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-95a5982b-5744-49cd-9f50-71288ea58801 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:56.089003 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95a5982b-5744-49cd-9f50-71288ea58801 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:56.089802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95a5982b-5744-49cd-9f50-71288ea58801 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:56.090643 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95a5982b-5744-49cd-9f50-71288ea58801 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:56.091625 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95a5982b-5744-49cd-9f50-71288ea58801 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:56.093537 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95a5982b-5744-49cd-9f50-71288ea58801 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:56.094089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95a5982b-5744-49cd-9f50-71288ea58801 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:56.369800 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:56.370406 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:56.377247 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:56.377743 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:56.378169 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:56.378874 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:56.379355 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:56.379775 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:56.672314 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-95a5982b-5744-49cd-9f50-71288ea58801 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:56.682610 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-95a5982b-5744-49cd-9f50-71288ea58801 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1708 microversion: 2.1 time: 0.605167 Aug 12 06:50:56.683673 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 193/380] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:56 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1708 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:56.747747 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:56.756562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:56.758143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:56.759431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b1af992f-251f-4a7e-8685-8a85c4685d66 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.393607 Aug 12 06:50:56.760076 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 188/381] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:56 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:57.089385 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8d9723ca-dc95-4766-8359-1e48467dbe2a tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:57.090164 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8d9723ca-dc95-4766-8359-1e48467dbe2a tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:57.095952 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d9723ca-dc95-4766-8359-1e48467dbe2a tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:57.096446 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d9723ca-dc95-4766-8359-1e48467dbe2a tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:57.096871 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d9723ca-dc95-4766-8359-1e48467dbe2a tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:57.097553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d9723ca-dc95-4766-8359-1e48467dbe2a tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:57.097996 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d9723ca-dc95-4766-8359-1e48467dbe2a tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:57.098428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d9723ca-dc95-4766-8359-1e48467dbe2a tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:57.332666 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8d9723ca-dc95-4766-8359-1e48467dbe2a tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:57.340834 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8d9723ca-dc95-4766-8359-1e48467dbe2a tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1318 microversion: 2.1 time: 0.255507 Aug 12 06:50:57.341338 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 194/382] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:57 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:57.706336 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-41195a61-d885-4685-a9d5-1f7d62dbcbef tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:57.706851 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-41195a61-d885-4685-a9d5-1f7d62dbcbef tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:57.716473 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-41195a61-d885-4685-a9d5-1f7d62dbcbef tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:57.717120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-41195a61-d885-4685-a9d5-1f7d62dbcbef tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:57.717648 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-41195a61-d885-4685-a9d5-1f7d62dbcbef tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:57.718632 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-41195a61-d885-4685-a9d5-1f7d62dbcbef tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:57.719199 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-41195a61-d885-4685-a9d5-1f7d62dbcbef tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:57.719584 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-41195a61-d885-4685-a9d5-1f7d62dbcbef tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:57.783641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:57.784238 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:57.790546 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:57.791050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:57.791513 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:57.792199 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:57.792638 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:57.793051 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:57.882605 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-41195a61-d885-4685-a9d5-1f7d62dbcbef tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:57.891203 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-41195a61-d885-4685-a9d5-1f7d62dbcbef tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1708 microversion: 2.1 time: 0.190625 Aug 12 06:50:57.891781 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 189/383] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:57 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1708 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:57.946517 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:57.954930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:57.956494 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:57.957592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c7b64893-d600-453d-85c6-61b36a0286b2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.177915 Aug 12 06:50:57.958153 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 195/384] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:57 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:58.361980 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3a24698b-e029-45cb-8c19-f4d213fb49ac tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:58.362589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3a24698b-e029-45cb-8c19-f4d213fb49ac tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:58.368863 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a24698b-e029-45cb-8c19-f4d213fb49ac tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:58.369370 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a24698b-e029-45cb-8c19-f4d213fb49ac tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:58.369824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a24698b-e029-45cb-8c19-f4d213fb49ac tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:58.370546 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a24698b-e029-45cb-8c19-f4d213fb49ac tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:58.371003 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a24698b-e029-45cb-8c19-f4d213fb49ac tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:58.371518 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a24698b-e029-45cb-8c19-f4d213fb49ac tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:58.650338 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3a24698b-e029-45cb-8c19-f4d213fb49ac tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:58.660716 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3a24698b-e029-45cb-8c19-f4d213fb49ac tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1318 microversion: 2.1 time: 0.302646 Aug 12 06:50:58.661272 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 190/385] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:58 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:58.913255 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d7c02ac9-8da0-4b33-bfb0-c6105a8c4f97 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:58.914009 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d7c02ac9-8da0-4b33-bfb0-c6105a8c4f97 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:58.920374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d7c02ac9-8da0-4b33-bfb0-c6105a8c4f97 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:58.920859 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d7c02ac9-8da0-4b33-bfb0-c6105a8c4f97 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:58.921306 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d7c02ac9-8da0-4b33-bfb0-c6105a8c4f97 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:58.922000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d7c02ac9-8da0-4b33-bfb0-c6105a8c4f97 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:58.922474 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d7c02ac9-8da0-4b33-bfb0-c6105a8c4f97 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:58.922912 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d7c02ac9-8da0-4b33-bfb0-c6105a8c4f97 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:58.951039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-bdf2cb58-738a-4471-b15d-e7129b4bdf2a req-bec98a43-7b0e-4594-a1ff-97e71275d75c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf06507b-28e3-41f2-ac29-84475ca09baa", "tag": "d22bbdd6-71cd-4165-abdf-54e6d2169c7d"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:50:58.964570 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-bdf2cb58-738a-4471-b15d-e7129b4bdf2a req-bec98a43-7b0e-4594-a1ff-97e71275d75c service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:58.965575 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-bdf2cb58-738a-4471-b15d-e7129b4bdf2a req-bec98a43-7b0e-4594-a1ff-97e71275d75c service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:58.966173 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-bdf2cb58-738a-4471-b15d-e7129b4bdf2a req-bec98a43-7b0e-4594-a1ff-97e71275d75c service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:58.979602 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-bdf2cb58-738a-4471-b15d-e7129b4bdf2a req-bec98a43-7b0e-4594-a1ff-97e71275d75c service nova] Creating event network-changed:d22bbdd6-71cd-4165-abdf-54e6d2169c7d for instance bf06507b-28e3-41f2-ac29-84475ca09baa on hv-cinder-84457 Aug 12 06:50:58.984521 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-bdf2cb58-738a-4471-b15d-e7129b4bdf2a req-bec98a43-7b0e-4594-a1ff-97e71275d75c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040044 Aug 12 06:50:58.985165 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 191/386] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:50:58.991641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:58.992661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:58.999754 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:59.000254 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:59.000709 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:59.001494 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:59.002228 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:59.002537 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:59.205264 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d7c02ac9-8da0-4b33-bfb0-c6105a8c4f97 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:59.213852 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d7c02ac9-8da0-4b33-bfb0-c6105a8c4f97 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1712 microversion: 2.1 time: 0.304595 Aug 12 06:50:59.214398 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 196/387] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:58 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1712 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:50:59.273164 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:59.283469 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:59.285626 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:59.286840 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e7ed0ba6-8076-4242-bc18-16f50306a260 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.300557 Aug 12 06:50:59.287721 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 192/388] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:50:58 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:50:59.686910 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-915cd5a9-3756-4a4f-95df-ac3bf2854036 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:50:59.687623 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-915cd5a9-3756-4a4f-95df-ac3bf2854036 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:50:59.695776 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-915cd5a9-3756-4a4f-95df-ac3bf2854036 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:59.696378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-915cd5a9-3756-4a4f-95df-ac3bf2854036 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:59.696968 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-915cd5a9-3756-4a4f-95df-ac3bf2854036 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:59.697997 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-915cd5a9-3756-4a4f-95df-ac3bf2854036 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:50:59.698598 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-915cd5a9-3756-4a4f-95df-ac3bf2854036 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:50:59.699595 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-915cd5a9-3756-4a4f-95df-ac3bf2854036 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:50:59.837993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-915cd5a9-3756-4a4f-95df-ac3bf2854036 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:50:59.845742 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-915cd5a9-3756-4a4f-95df-ac3bf2854036 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1318 microversion: 2.1 time: 0.164167 Aug 12 06:50:59.846312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 197/389] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:50:59 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:00.313782 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:00.314733 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:00.325744 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:00.326694 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:00.327447 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:00.328570 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:00.329305 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:00.330003 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:00.469146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:00.477807 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:00.479306 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:00.480442 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e587628d-0835-44a3-b90a-dddce0e6d52b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.173270 Aug 12 06:51:00.481008 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 193/390] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:51:00 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:51:00.870757 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c57c7575-cc06-4130-a4f1-4b69ef45ad8f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:00.871991 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c57c7575-cc06-4130-a4f1-4b69ef45ad8f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:00.882059 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c57c7575-cc06-4130-a4f1-4b69ef45ad8f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:00.883029 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c57c7575-cc06-4130-a4f1-4b69ef45ad8f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:00.883491 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c57c7575-cc06-4130-a4f1-4b69ef45ad8f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:00.887375 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c57c7575-cc06-4130-a4f1-4b69ef45ad8f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:00.887859 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c57c7575-cc06-4130-a4f1-4b69ef45ad8f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:00.888292 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c57c7575-cc06-4130-a4f1-4b69ef45ad8f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:00.890994 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:01.045965 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c57c7575-cc06-4130-a4f1-4b69ef45ad8f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:01.056614 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c57c7575-cc06-4130-a4f1-4b69ef45ad8f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1318 microversion: 2.1 time: 0.192283 Aug 12 06:51:01.057195 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 198/391] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:00 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:01.507380 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:01.508345 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:01.510893 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:01.511636 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:01.519187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:01.519666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:01.520097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:01.521252 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:01.521697 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:01.522112 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:01.659520 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:01.668281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:01.669756 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:01.670890 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-46c0608a-b640-43c4-af9d-17a50d37b199 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.170001 Aug 12 06:51:01.671480 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 194/392] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:51:01 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:51:02.077677 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ad534fc5-44dd-4e10-b42d-06960a38cebf tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:02.078308 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ad534fc5-44dd-4e10-b42d-06960a38cebf tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:02.080285 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:02.085784 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad534fc5-44dd-4e10-b42d-06960a38cebf tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:02.086263 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad534fc5-44dd-4e10-b42d-06960a38cebf tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:02.086691 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad534fc5-44dd-4e10-b42d-06960a38cebf tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:02.087421 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad534fc5-44dd-4e10-b42d-06960a38cebf tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:02.087874 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad534fc5-44dd-4e10-b42d-06960a38cebf tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:02.088293 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad534fc5-44dd-4e10-b42d-06960a38cebf tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:02.295346 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ad534fc5-44dd-4e10-b42d-06960a38cebf tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:02.304160 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ad534fc5-44dd-4e10-b42d-06960a38cebf tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1318 microversion: 2.1 time: 0.230319 Aug 12 06:51:02.304779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 199/393] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:02 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:02.699608 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:02.700493 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:02.711457 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:02.711936 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:02.712352 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:02.713049 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:02.713503 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:02.713918 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:02.846716 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:02.855492 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:02.857001 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:02.858152 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-24184ab5-fa60-41fc-8866-4b9afc7e2ab0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.166133 Aug 12 06:51:02.858781 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 195/394] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:51:02 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:51:03.329042 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3dc54838-270d-4845-bbed-288c8ea694ae tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:03.330217 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3dc54838-270d-4845-bbed-288c8ea694ae tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:03.338738 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc54838-270d-4845-bbed-288c8ea694ae tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:03.339248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc54838-270d-4845-bbed-288c8ea694ae tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:03.339708 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc54838-270d-4845-bbed-288c8ea694ae tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:03.340380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc54838-270d-4845-bbed-288c8ea694ae tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:03.340827 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc54838-270d-4845-bbed-288c8ea694ae tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:03.341241 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc54838-270d-4845-bbed-288c8ea694ae tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:03.681005 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3dc54838-270d-4845-bbed-288c8ea694ae tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:03.689210 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3dc54838-270d-4845-bbed-288c8ea694ae tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1318 microversion: 2.1 time: 0.366995 Aug 12 06:51:03.689768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 200/395] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:03 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:03.881644 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:03.882226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:03.889139 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:03.889588 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:03.890014 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:03.890702 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:03.891165 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:03.891608 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:04.021079 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:04.030116 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:04.031655 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:04.032810 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d082be1f-b66b-4035-82a2-b3388d8a2d74 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.155332 Aug 12 06:51:04.033376 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 196/396] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:51:03 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:51:04.558675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-e2c77354-3173-4a84-bfc1-47f4708bf014 req-01763020-7abb-4529-b7bb-cdbd6d4277b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf06507b-28e3-41f2-ac29-84475ca09baa", "name": "network-vif-plugged", "status": "completed", "tag": "d22bbdd6-71cd-4165-abdf-54e6d2169c7d"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:51:04.568871 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e2c77354-3173-4a84-bfc1-47f4708bf014 req-01763020-7abb-4529-b7bb-cdbd6d4277b3 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:04.569339 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e2c77354-3173-4a84-bfc1-47f4708bf014 req-01763020-7abb-4529-b7bb-cdbd6d4277b3 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:04.569889 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e2c77354-3173-4a84-bfc1-47f4708bf014 req-01763020-7abb-4529-b7bb-cdbd6d4277b3 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:04.581268 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-e2c77354-3173-4a84-bfc1-47f4708bf014 req-01763020-7abb-4529-b7bb-cdbd6d4277b3 service nova] Creating event network-vif-plugged:d22bbdd6-71cd-4165-abdf-54e6d2169c7d for instance bf06507b-28e3-41f2-ac29-84475ca09baa on hv-cinder-84457 Aug 12 06:51:04.586378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-e2c77354-3173-4a84-bfc1-47f4708bf014 req-01763020-7abb-4529-b7bb-cdbd6d4277b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031439 Aug 12 06:51:04.587000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 201/397] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:04.709992 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8cfc71d3-e862-4936-8263-25a5c6eb7626 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:04.710685 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8cfc71d3-e862-4936-8263-25a5c6eb7626 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:04.716715 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cfc71d3-e862-4936-8263-25a5c6eb7626 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:04.717188 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cfc71d3-e862-4936-8263-25a5c6eb7626 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:04.717607 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cfc71d3-e862-4936-8263-25a5c6eb7626 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:04.718289 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cfc71d3-e862-4936-8263-25a5c6eb7626 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:04.718729 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cfc71d3-e862-4936-8263-25a5c6eb7626 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:04.719172 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cfc71d3-e862-4936-8263-25a5c6eb7626 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:04.890897 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8cfc71d3-e862-4936-8263-25a5c6eb7626 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:04.899304 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8cfc71d3-e862-4936-8263-25a5c6eb7626 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1318 microversion: 2.1 time: 0.193082 Aug 12 06:51:04.900306 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 197/398] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:04 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:05.060418 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:05.061109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:05.067418 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:05.067891 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:05.068313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:05.068992 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:05.069432 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:05.069843 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:05.203554 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:05.215871 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:05.218229 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:05.220002 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-456cf9e7-70e0-42d9-8746-3067cc9e0b7e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.163804 Aug 12 06:51:05.220876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 202/399] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:51:05 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:51:05.925424 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-58b93b13-9b70-4b59-bc9e-a2ef11191fc2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:05.926195 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-58b93b13-9b70-4b59-bc9e-a2ef11191fc2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:05.936289 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58b93b13-9b70-4b59-bc9e-a2ef11191fc2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:05.937028 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58b93b13-9b70-4b59-bc9e-a2ef11191fc2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:05.937732 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58b93b13-9b70-4b59-bc9e-a2ef11191fc2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:05.938771 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58b93b13-9b70-4b59-bc9e-a2ef11191fc2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:05.939523 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58b93b13-9b70-4b59-bc9e-a2ef11191fc2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:05.940172 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58b93b13-9b70-4b59-bc9e-a2ef11191fc2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:06.073123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-58b93b13-9b70-4b59-bc9e-a2ef11191fc2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:06.080818 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-58b93b13-9b70-4b59-bc9e-a2ef11191fc2 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1318 microversion: 2.1 time: 0.161572 Aug 12 06:51:06.081392 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 198/400] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:05 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:06.247677 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:06.248266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:06.254752 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:06.255282 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:06.255709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:06.256395 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:06.256838 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:06.257409 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:06.392935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:06.401838 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:06.403342 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:06.404482 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-707c5d21-f466-49eb-823a-1244dcda01a5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.163395 Aug 12 06:51:06.405011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 203/401] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:51:06 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:51:06.604627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-75af9532-9def-4440-bd62-3360c9887d41 req-8a3de015-49a9-4d02-b1cd-0409e78737d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bc12e0-d758-47a7-920d-971a6e993711", "name": "network-vif-plugged", "status": "completed", "tag": "2de31bfc-bbcb-4a81-989c-adfbe72a2aac"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:51:06.614687 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-75af9532-9def-4440-bd62-3360c9887d41 req-8a3de015-49a9-4d02-b1cd-0409e78737d8 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:06.615205 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-75af9532-9def-4440-bd62-3360c9887d41 req-8a3de015-49a9-4d02-b1cd-0409e78737d8 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:06.615636 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-75af9532-9def-4440-bd62-3360c9887d41 req-8a3de015-49a9-4d02-b1cd-0409e78737d8 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:06.626669 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-75af9532-9def-4440-bd62-3360c9887d41 req-8a3de015-49a9-4d02-b1cd-0409e78737d8 service nova] Creating event network-vif-plugged:2de31bfc-bbcb-4a81-989c-adfbe72a2aac for instance a6bc12e0-d758-47a7-920d-971a6e993711 on hv-cinder-84457 Aug 12 06:51:06.631550 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-75af9532-9def-4440-bd62-3360c9887d41 req-8a3de015-49a9-4d02-b1cd-0409e78737d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031425 Aug 12 06:51:06.632115 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 199/402] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:07.105648 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ce43a524-a4c9-447b-8e37-94660558be20 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:07.106758 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ce43a524-a4c9-447b-8e37-94660558be20 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:07.116784 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce43a524-a4c9-447b-8e37-94660558be20 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:07.117477 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce43a524-a4c9-447b-8e37-94660558be20 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:07.117908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce43a524-a4c9-447b-8e37-94660558be20 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:07.118596 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce43a524-a4c9-447b-8e37-94660558be20 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:07.119085 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce43a524-a4c9-447b-8e37-94660558be20 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:07.119506 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce43a524-a4c9-447b-8e37-94660558be20 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:07.260425 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ce43a524-a4c9-447b-8e37-94660558be20 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:07.268976 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ce43a524-a4c9-447b-8e37-94660558be20 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1508 microversion: 2.1 time: 0.170010 Aug 12 06:51:07.269772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 204/403] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:07 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:07.429217 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:07.430030 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:07.437640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:07.438330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:07.438859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:07.439637 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:07.440148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:07.440626 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:07.596739 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:07.605813 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:07.607415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:07.608530 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bd777e25-7c76-441c-8ba9-eebc68bb8d5d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.184334 Aug 12 06:51:07.609082 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 200/404] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:51:07 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:51:08.633964 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:08.634617 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:08.636575 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:08.641979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:08.642448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:08.642867 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:08.643576 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:08.644017 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:08.644432 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:08.776587 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:08.784967 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:08.786455 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:08.787782 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0ea8ecc7-9a86-4177-a01e-8b9836336cc0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.157700 Aug 12 06:51:08.788378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 205/405] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:51:08 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:51:09.811995 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:09.812589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:09.818932 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:09.819445 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:09.819878 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:09.820675 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:09.821143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:09.821558 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:09.826768 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:09.961708 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:09.975295 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:09.976872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:09.978301 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4fc70a78-cdf8-4942-92de-083e37f94e4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1809 microversion: 2.20 time: 0.170360 Aug 12 06:51:09.979042 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 201/406] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:51:09 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:51:11.004853 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:11.005485 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:11.013109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:11.013612 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:11.014033 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:11.014773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:11.015260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:11.015672 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:11.158758 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:11.167507 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:11.168981 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:11.170154 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-82f0eb4e-2504-4b3a-8361-dc64e9bf2dd1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1796 microversion: 2.20 time: 0.171340 Aug 12 06:51:11.170706 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 206/407] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:51:10 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1796 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:51:21.087883 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-db44e537-2756-4610-aac7-b1baa8e08f0b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:21.088854 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-db44e537-2756-4610-aac7-b1baa8e08f0b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:21.091989 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=37 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:21.093034 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=4 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:21.102334 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db44e537-2756-4610-aac7-b1baa8e08f0b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:21.102859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db44e537-2756-4610-aac7-b1baa8e08f0b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:21.103304 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db44e537-2756-4610-aac7-b1baa8e08f0b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:21.103990 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db44e537-2756-4610-aac7-b1baa8e08f0b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:21.104439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db44e537-2756-4610-aac7-b1baa8e08f0b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:21.104855 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-db44e537-2756-4610-aac7-b1baa8e08f0b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:21.128781 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-db44e537-2756-4610-aac7-b1baa8e08f0b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577/ips" status: 200 len: 151 microversion: 2.1 time: 0.047748 Aug 12 06:51:21.129344 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 202/408] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 06:51:21 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:21.141926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0af5da2-2ca2-4d79-8313-4956f687f2cc"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:51:21.144675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:21.147157 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:21.152608 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:21.153042 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:21.153546 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:21.154313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:21.154756 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:21.155211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:21.240159 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Invalid volume: volume b0af5da2-2ca2-4d79-8313-4956f687f2cc is already attached to instances: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: POST /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577/os-volume_attachments HTTP/1.1 Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 74 Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:51:21.241870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {"volumeAttachment": {"volumeId": "b0af5da2-2ca2-4d79-8313-4956f687f2cc"}} Aug 12 06:51:21.243429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Invalid volume: volume b0af5da2-2ca2-4d79-8313-4956f687f2cc is already attached to instances: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'server_id': '205712a3-060e-4c1a-a2c2-dd9130af8577', 'body': {'volumeAttachment': {'volumeId': 'b0af5da2-2ca2-4d79-8313-4956f687f2cc'}}} Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b0af5da2-2ca2-4d79-8313-4956f687f2cc is already attached to instances: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:21.244205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b0af5da2-2ca2-4d79-8313-4956f687f2cc is already attached to instances: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:21.245524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:51:21.246886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:51:21.246886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:51:21.246886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:51:21.246886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b0af5da2-2ca2-4d79-8313-4956f687f2cc is already attached to instances: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 Aug 12 06:51:21.246886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:21.246886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 400 to user: Invalid volume: volume b0af5da2-2ca2-4d79-8313-4956f687f2cc is already attached to instances: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:51:21.246886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ee753ff3-3a7a-4410-a51c-f3216d1a2267 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105520 Aug 12 06:51:21.246886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 207/409] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:51:21 2022] POST /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 06:51:21.252582 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-11955aad-575e-4395-bd5a-7e2ea5224752 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:21.253098 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-11955aad-575e-4395-bd5a-7e2ea5224752 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:21.259426 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-11955aad-575e-4395-bd5a-7e2ea5224752 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:21.259909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-11955aad-575e-4395-bd5a-7e2ea5224752 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:21.260336 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-11955aad-575e-4395-bd5a-7e2ea5224752 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:21.261017 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-11955aad-575e-4395-bd5a-7e2ea5224752 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:21.261463 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-11955aad-575e-4395-bd5a-7e2ea5224752 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:21.261878 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-11955aad-575e-4395-bd5a-7e2ea5224752 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:21.288263 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-11955aad-575e-4395-bd5a-7e2ea5224752 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:51:21.380450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-11955aad-575e-4395-bd5a-7e2ea5224752 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 204 len: 0 microversion: 2.1 time: 0.131358 Aug 12 06:51:21.380949 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 203/410] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:51:21 2022] DELETE /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 06:51:21.389226 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bbc3b4ac-b16e-4921-ae69-161fcb1bb8b9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:21.389828 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bbc3b4ac-b16e-4921-ae69-161fcb1bb8b9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:21.397495 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbc3b4ac-b16e-4921-ae69-161fcb1bb8b9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:21.397976 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbc3b4ac-b16e-4921-ae69-161fcb1bb8b9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:21.398402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbc3b4ac-b16e-4921-ae69-161fcb1bb8b9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:21.399245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbc3b4ac-b16e-4921-ae69-161fcb1bb8b9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:21.399702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbc3b4ac-b16e-4921-ae69-161fcb1bb8b9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:21.400123 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbc3b4ac-b16e-4921-ae69-161fcb1bb8b9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:21.534099 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bbc3b4ac-b16e-4921-ae69-161fcb1bb8b9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:21.543761 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bbc3b4ac-b16e-4921-ae69-161fcb1bb8b9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1683 microversion: 2.1 time: 0.158327 Aug 12 06:51:21.544299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 208/411] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:21 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:22.565830 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cbc3dccf-f8b3-49de-b966-2ed1890a7861 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:22.566441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cbc3dccf-f8b3-49de-b966-2ed1890a7861 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:22.573125 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbc3dccf-f8b3-49de-b966-2ed1890a7861 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:22.573675 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbc3dccf-f8b3-49de-b966-2ed1890a7861 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:22.574104 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbc3dccf-f8b3-49de-b966-2ed1890a7861 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:22.574793 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbc3dccf-f8b3-49de-b966-2ed1890a7861 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:22.575269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbc3dccf-f8b3-49de-b966-2ed1890a7861 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:22.575678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbc3dccf-f8b3-49de-b966-2ed1890a7861 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:22.708645 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cbc3dccf-f8b3-49de-b966-2ed1890a7861 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:22.716584 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cbc3dccf-f8b3-49de-b966-2ed1890a7861 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1683 microversion: 2.1 time: 0.155066 Aug 12 06:51:22.717148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 204/412] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:22 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:23.741672 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-08db1fb8-693d-4487-a7e3-d5b536d98089 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:23.742696 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-08db1fb8-693d-4487-a7e3-d5b536d98089 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:23.749105 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08db1fb8-693d-4487-a7e3-d5b536d98089 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:23.749585 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08db1fb8-693d-4487-a7e3-d5b536d98089 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:23.750017 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08db1fb8-693d-4487-a7e3-d5b536d98089 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:23.750704 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08db1fb8-693d-4487-a7e3-d5b536d98089 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:23.751193 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08db1fb8-693d-4487-a7e3-d5b536d98089 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:23.751613 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08db1fb8-693d-4487-a7e3-d5b536d98089 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:23.925718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-08db1fb8-693d-4487-a7e3-d5b536d98089 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:23.933499 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-08db1fb8-693d-4487-a7e3-d5b536d98089 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1683 microversion: 2.1 time: 0.198208 Aug 12 06:51:23.934084 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 209/413] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:23 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1683 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:23.978498 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e8f2a650-57d1-4e0f-a454-0b052542b3d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f538766-788b-4247-ae2f-37f4d803bdbb"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:51:23.981564 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e8f2a650-57d1-4e0f-a454-0b052542b3d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:23.989767 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8f2a650-57d1-4e0f-a454-0b052542b3d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:23.990294 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8f2a650-57d1-4e0f-a454-0b052542b3d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:23.990755 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8f2a650-57d1-4e0f-a454-0b052542b3d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:23.991549 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8f2a650-57d1-4e0f-a454-0b052542b3d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:23.992315 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8f2a650-57d1-4e0f-a454-0b052542b3d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:23.992947 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8f2a650-57d1-4e0f-a454-0b052542b3d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:24.280440 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e8f2a650-57d1-4e0f-a454-0b052542b3d3 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "POST /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306318 Aug 12 06:51:24.286506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 205/414] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:51:23 2022] POST /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:24.659873 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b3049005-f81d-4840-9525-8b6ada5c5156 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5058735-b9aa-4ba4-b270-eba2f2508fff", "device": "/dev/sdb"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:51:24.663086 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b3049005-f81d-4840-9525-8b6ada5c5156 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:24.670182 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3049005-f81d-4840-9525-8b6ada5c5156 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:24.670716 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3049005-f81d-4840-9525-8b6ada5c5156 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:24.671239 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3049005-f81d-4840-9525-8b6ada5c5156 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:24.672023 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3049005-f81d-4840-9525-8b6ada5c5156 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:24.672446 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3049005-f81d-4840-9525-8b6ada5c5156 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:24.672866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3049005-f81d-4840-9525-8b6ada5c5156 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:24.823940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-3655e1e0-e409-41fc-be0b-c4e48888daed req-242f4713-7605-4a39-8895-0564bf46e1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205712a3-060e-4c1a-a2c2-dd9130af8577", "name": "network-vif-deleted", "tag": "60906462-e7fb-48a2-911f-43a5cce62879"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:51:24.842803 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3655e1e0-e409-41fc-be0b-c4e48888daed req-242f4713-7605-4a39-8895-0564bf46e1a2 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:24.843992 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3655e1e0-e409-41fc-be0b-c4e48888daed req-242f4713-7605-4a39-8895-0564bf46e1a2 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:24.844135 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3655e1e0-e409-41fc-be0b-c4e48888daed req-242f4713-7605-4a39-8895-0564bf46e1a2 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:24.858710 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-3655e1e0-e409-41fc-be0b-c4e48888daed req-242f4713-7605-4a39-8895-0564bf46e1a2 service nova] Creating event network-vif-deleted:60906462-e7fb-48a2-911f-43a5cce62879 for instance 205712a3-060e-4c1a-a2c2-dd9130af8577 on hv-cinder-84457 Aug 12 06:51:24.863912 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-3655e1e0-e409-41fc-be0b-c4e48888daed req-242f4713-7605-4a39-8895-0564bf46e1a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044042 Aug 12 06:51:24.865327 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 206/415] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:51:24.957082 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0887410f-83d4-4ff5-80ee-c114a47bfc15 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:24.958045 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0887410f-83d4-4ff5-80ee-c114a47bfc15 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:24.966835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0887410f-83d4-4ff5-80ee-c114a47bfc15 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:24.967647 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0887410f-83d4-4ff5-80ee-c114a47bfc15 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:24.968236 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0887410f-83d4-4ff5-80ee-c114a47bfc15 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:24.969162 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0887410f-83d4-4ff5-80ee-c114a47bfc15 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:24.969802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0887410f-83d4-4ff5-80ee-c114a47bfc15 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:24.970364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0887410f-83d4-4ff5-80ee-c114a47bfc15 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:25.021617 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b3049005-f81d-4840-9525-8b6ada5c5156 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "POST /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366578 Aug 12 06:51:25.022875 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 210/416] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:51:24 2022] POST /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:25.069581 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0887410f-83d4-4ff5-80ee-c114a47bfc15 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:25.084789 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0887410f-83d4-4ff5-80ee-c114a47bfc15 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 200 len: 1326 microversion: 2.1 time: 0.128247 Aug 12 06:51:25.087959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 207/417] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:24 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 1326 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:26.111663 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:26.112352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:26.122488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:26.123159 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:26.123761 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:26.124658 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:26.125102 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:26.125678 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:26.139642 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 HTTP/1.1 Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:51:26.141567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:51:26.142826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '205712a3-060e-4c1a-a2c2-dd9130af8577'} Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:51:26.143786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:51:26.145945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:26.147363 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:51:26.147363 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eebd2f77-df1f-43fd-9584-379203faaeb6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 404 len: 111 microversion: 2.1 time: 0.036033 Aug 12 06:51:26.147363 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 211/418] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:26 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:51:26.152685 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f79b6eac-4a48-4d3c-9f3c-7e90c93968dc tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '.version_select at 0x7fc70462e790>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:26.181339 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f79b6eac-4a48-4d3c-9f3c-7e90c93968dc tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153866364" status: 202 len: 0 microversion: 2.1 time: 0.032286 Aug 12 06:51:26.182016 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 208/419] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Aug 12 06:51:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153866364 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:51:26.876255 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-13a09f74-fa96-4a0d-87b2-c970c43273eb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:26.876769 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-13a09f74-fa96-4a0d-87b2-c970c43273eb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:26.883485 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a09f74-fa96-4a0d-87b2-c970c43273eb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:26.884047 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a09f74-fa96-4a0d-87b2-c970c43273eb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:26.884494 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a09f74-fa96-4a0d-87b2-c970c43273eb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:26.885153 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a09f74-fa96-4a0d-87b2-c970c43273eb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:26.885592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a09f74-fa96-4a0d-87b2-c970c43273eb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:26.886000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a09f74-fa96-4a0d-87b2-c970c43273eb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:27.017606 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-13a09f74-fa96-4a0d-87b2-c970c43273eb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lazy-loading 'services' on Instance uuid 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:51:27.139504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-13a09f74-fa96-4a0d-87b2-c970c43273eb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments/b0af5da2-2ca2-4d79-8313-4956f687f2cc" status: 202 len: 0 microversion: 2.1 time: 0.267179 Aug 12 06:51:27.140548 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 212/420] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:51:26 2022] DELETE /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments/b0af5da2-2ca2-4d79-8313-4956f687f2cc => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:51:27.149176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-512201b4-f45c-47de-b408-0d9eda2ce9ee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:27.151392 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-512201b4-f45c-47de-b408-0d9eda2ce9ee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:27.158616 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-512201b4-f45c-47de-b408-0d9eda2ce9ee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:27.159238 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-512201b4-f45c-47de-b408-0d9eda2ce9ee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:27.159550 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-512201b4-f45c-47de-b408-0d9eda2ce9ee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:27.160251 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-512201b4-f45c-47de-b408-0d9eda2ce9ee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:27.160695 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-512201b4-f45c-47de-b408-0d9eda2ce9ee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:27.161107 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-512201b4-f45c-47de-b408-0d9eda2ce9ee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:27.191485 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-512201b4-f45c-47de-b408-0d9eda2ce9ee tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046742 Aug 12 06:51:27.192059 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 209/421] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:27 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:28.205551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-117840ae-279a-4b47-8cc2-65545eeff75f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:28.207885 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-117840ae-279a-4b47-8cc2-65545eeff75f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:28.215338 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-117840ae-279a-4b47-8cc2-65545eeff75f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:28.215824 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-117840ae-279a-4b47-8cc2-65545eeff75f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:28.216261 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-117840ae-279a-4b47-8cc2-65545eeff75f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:28.216948 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-117840ae-279a-4b47-8cc2-65545eeff75f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:28.217407 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-117840ae-279a-4b47-8cc2-65545eeff75f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:28.217822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-117840ae-279a-4b47-8cc2-65545eeff75f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:28.250117 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-117840ae-279a-4b47-8cc2-65545eeff75f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049371 Aug 12 06:51:28.250923 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 213/422] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:28 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:29.262801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e288255c-1ff0-4e00-90b5-c3257e14b815 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:29.264990 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e288255c-1ff0-4e00-90b5-c3257e14b815 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:29.271880 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e288255c-1ff0-4e00-90b5-c3257e14b815 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:29.272363 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e288255c-1ff0-4e00-90b5-c3257e14b815 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:29.272823 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e288255c-1ff0-4e00-90b5-c3257e14b815 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:29.273507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e288255c-1ff0-4e00-90b5-c3257e14b815 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:29.273958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e288255c-1ff0-4e00-90b5-c3257e14b815 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:29.274373 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e288255c-1ff0-4e00-90b5-c3257e14b815 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:29.305578 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e288255c-1ff0-4e00-90b5-c3257e14b815 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046754 Aug 12 06:51:29.306070 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 210/423] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:29 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:30.321882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5d3b3616-a63f-488b-a84f-b340470bb07c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:30.325336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5d3b3616-a63f-488b-a84f-b340470bb07c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:30.336145 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d3b3616-a63f-488b-a84f-b340470bb07c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:30.336778 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d3b3616-a63f-488b-a84f-b340470bb07c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:30.337211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d3b3616-a63f-488b-a84f-b340470bb07c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:30.337902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d3b3616-a63f-488b-a84f-b340470bb07c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:30.338346 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d3b3616-a63f-488b-a84f-b340470bb07c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:30.338768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d3b3616-a63f-488b-a84f-b340470bb07c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:30.341306 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:30.370250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5d3b3616-a63f-488b-a84f-b340470bb07c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055182 Aug 12 06:51:30.370808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 214/424] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:30 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:31.382267 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-16659c93-43fc-41aa-b2f3-b251c5fe6d55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:31.384727 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-16659c93-43fc-41aa-b2f3-b251c5fe6d55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:31.391904 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-16659c93-43fc-41aa-b2f3-b251c5fe6d55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:31.392356 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-16659c93-43fc-41aa-b2f3-b251c5fe6d55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:31.392784 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-16659c93-43fc-41aa-b2f3-b251c5fe6d55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:31.393473 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-16659c93-43fc-41aa-b2f3-b251c5fe6d55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:31.393918 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-16659c93-43fc-41aa-b2f3-b251c5fe6d55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:31.394334 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-16659c93-43fc-41aa-b2f3-b251c5fe6d55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:31.425459 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-16659c93-43fc-41aa-b2f3-b251c5fe6d55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047407 Aug 12 06:51:31.430029 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 211/425] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:31 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:31.866526 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-565ea64c-977c-4248-adf4-1afabfe677be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:51:31.868794 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-565ea64c-977c-4248-adf4-1afabfe677be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:31.875560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565ea64c-977c-4248-adf4-1afabfe677be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:31.876045 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565ea64c-977c-4248-adf4-1afabfe677be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:31.876519 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565ea64c-977c-4248-adf4-1afabfe677be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:31.877203 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565ea64c-977c-4248-adf4-1afabfe677be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:31.877659 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565ea64c-977c-4248-adf4-1afabfe677be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:31.878077 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565ea64c-977c-4248-adf4-1afabfe677be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:31.901045 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-565ea64c-977c-4248-adf4-1afabfe677be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lazy-loading 'flavor' on Instance uuid 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:51:32.033867 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-565ea64c-977c-4248-adf4-1afabfe677be tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "POST /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/action" status: 200 len: 32 microversion: 2.1 time: 0.170660 Aug 12 06:51:32.035029 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 215/426] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:51:31 2022] POST /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 06:51:32.045438 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9ce89895-755c-41bf-b1a5-dc6fb706fcf0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:32.046139 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9ce89895-755c-41bf-b1a5-dc6fb706fcf0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:32.053195 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ce89895-755c-41bf-b1a5-dc6fb706fcf0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:32.053775 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ce89895-755c-41bf-b1a5-dc6fb706fcf0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:32.054211 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ce89895-755c-41bf-b1a5-dc6fb706fcf0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:32.055148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ce89895-755c-41bf-b1a5-dc6fb706fcf0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:32.055641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ce89895-755c-41bf-b1a5-dc6fb706fcf0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:32.056059 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ce89895-755c-41bf-b1a5-dc6fb706fcf0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:32.231384 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9ce89895-755c-41bf-b1a5-dc6fb706fcf0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:32.239615 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9ce89895-755c-41bf-b1a5-dc6fb706fcf0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.198714 Aug 12 06:51:32.240208 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 212/427] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:32 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:32.438518 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e07eca10-6568-44fa-8b33-d0e67db69733 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:32.440793 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e07eca10-6568-44fa-8b33-d0e67db69733 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:32.447120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e07eca10-6568-44fa-8b33-d0e67db69733 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:32.447599 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e07eca10-6568-44fa-8b33-d0e67db69733 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:32.448016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e07eca10-6568-44fa-8b33-d0e67db69733 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:32.448718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e07eca10-6568-44fa-8b33-d0e67db69733 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:32.449162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e07eca10-6568-44fa-8b33-d0e67db69733 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:32.449574 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e07eca10-6568-44fa-8b33-d0e67db69733 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:32.479126 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e07eca10-6568-44fa-8b33-d0e67db69733 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044884 Aug 12 06:51:32.479646 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 216/428] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:32 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:33.265100 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f95a8d56-ec50-4859-9e50-341aedc6ca95 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:33.266138 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f95a8d56-ec50-4859-9e50-341aedc6ca95 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:33.275928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f95a8d56-ec50-4859-9e50-341aedc6ca95 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:33.276409 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f95a8d56-ec50-4859-9e50-341aedc6ca95 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:33.276841 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f95a8d56-ec50-4859-9e50-341aedc6ca95 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:33.277529 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f95a8d56-ec50-4859-9e50-341aedc6ca95 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:33.277977 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f95a8d56-ec50-4859-9e50-341aedc6ca95 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:33.278395 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f95a8d56-ec50-4859-9e50-341aedc6ca95 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:33.415428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f95a8d56-ec50-4859-9e50-341aedc6ca95 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:33.423980 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f95a8d56-ec50-4859-9e50-341aedc6ca95 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.165361 Aug 12 06:51:33.424640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 213/429] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:33 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:33.493765 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-946bdd30-5769-4553-a901-65f74444aed4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:33.495902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-946bdd30-5769-4553-a901-65f74444aed4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:33.503593 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5769-4553-a901-65f74444aed4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:33.504243 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5769-4553-a901-65f74444aed4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:33.504836 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5769-4553-a901-65f74444aed4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:33.505834 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5769-4553-a901-65f74444aed4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:33.506457 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5769-4553-a901-65f74444aed4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:33.507032 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5769-4553-a901-65f74444aed4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:33.540552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-946bdd30-5769-4553-a901-65f74444aed4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052618 Aug 12 06:51:33.541110 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 217/430] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:33 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:34.448854 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2c1705c8-0deb-4890-930a-03d50fa3a16d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:34.449647 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2c1705c8-0deb-4890-930a-03d50fa3a16d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:34.458700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c1705c8-0deb-4890-930a-03d50fa3a16d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:34.459390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c1705c8-0deb-4890-930a-03d50fa3a16d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:34.459973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c1705c8-0deb-4890-930a-03d50fa3a16d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:34.460891 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c1705c8-0deb-4890-930a-03d50fa3a16d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:34.461497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c1705c8-0deb-4890-930a-03d50fa3a16d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:34.462057 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c1705c8-0deb-4890-930a-03d50fa3a16d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:34.553596 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a305ee36-435b-4a2d-8b5d-fcdba4edf062 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:34.555901 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a305ee36-435b-4a2d-8b5d-fcdba4edf062 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:34.562994 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a305ee36-435b-4a2d-8b5d-fcdba4edf062 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:34.563625 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a305ee36-435b-4a2d-8b5d-fcdba4edf062 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:34.564032 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a305ee36-435b-4a2d-8b5d-fcdba4edf062 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:34.564729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a305ee36-435b-4a2d-8b5d-fcdba4edf062 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:34.565186 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a305ee36-435b-4a2d-8b5d-fcdba4edf062 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:34.565605 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a305ee36-435b-4a2d-8b5d-fcdba4edf062 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:34.596528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a305ee36-435b-4a2d-8b5d-fcdba4edf062 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047103 Aug 12 06:51:34.597317 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 218/431] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:34 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:34.602060 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2c1705c8-0deb-4890-930a-03d50fa3a16d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:34.610415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2c1705c8-0deb-4890-930a-03d50fa3a16d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.167376 Aug 12 06:51:34.611023 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 214/432] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:34 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:35.613048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-359dc168-483c-46d4-96da-5502c924e312 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:35.616452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-359dc168-483c-46d4-96da-5502c924e312 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:35.623653 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-359dc168-483c-46d4-96da-5502c924e312 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:35.624131 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-359dc168-483c-46d4-96da-5502c924e312 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:35.624551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-359dc168-483c-46d4-96da-5502c924e312 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:35.625275 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-359dc168-483c-46d4-96da-5502c924e312 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:35.625763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-359dc168-483c-46d4-96da-5502c924e312 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:35.626367 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-359dc168-483c-46d4-96da-5502c924e312 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:35.632624 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8e67a6d6-9679-4a88-98dc-683c1b9ed510 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:35.633512 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8e67a6d6-9679-4a88-98dc-683c1b9ed510 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:35.642116 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e67a6d6-9679-4a88-98dc-683c1b9ed510 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:35.642755 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e67a6d6-9679-4a88-98dc-683c1b9ed510 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:35.643652 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e67a6d6-9679-4a88-98dc-683c1b9ed510 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:35.644891 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e67a6d6-9679-4a88-98dc-683c1b9ed510 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:35.647126 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e67a6d6-9679-4a88-98dc-683c1b9ed510 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:35.647126 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e67a6d6-9679-4a88-98dc-683c1b9ed510 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:35.659904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-359dc168-483c-46d4-96da-5502c924e312 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053397 Aug 12 06:51:35.660735 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 219/433] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:35 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:35.776982 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8e67a6d6-9679-4a88-98dc-683c1b9ed510 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:35.784873 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8e67a6d6-9679-4a88-98dc-683c1b9ed510 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.156486 Aug 12 06:51:35.785453 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 215/434] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:35 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:51:36.672883 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-abf7e5ed-130e-4cc7-a0c1-99690a82dbac tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:36.675571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-abf7e5ed-130e-4cc7-a0c1-99690a82dbac tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:36.683608 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf7e5ed-130e-4cc7-a0c1-99690a82dbac tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:36.684423 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf7e5ed-130e-4cc7-a0c1-99690a82dbac tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:36.684898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf7e5ed-130e-4cc7-a0c1-99690a82dbac tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:36.685578 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf7e5ed-130e-4cc7-a0c1-99690a82dbac tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:36.686053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf7e5ed-130e-4cc7-a0c1-99690a82dbac tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:36.686699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf7e5ed-130e-4cc7-a0c1-99690a82dbac tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:36.717137 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-abf7e5ed-130e-4cc7-a0c1-99690a82dbac tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048626 Aug 12 06:51:36.717706 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 220/435] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:36 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:36.807798 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-221bbe29-f96d-41e2-bda0-3d1aa3d16a63 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:36.808620 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-221bbe29-f96d-41e2-bda0-3d1aa3d16a63 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:36.816642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-221bbe29-f96d-41e2-bda0-3d1aa3d16a63 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:36.817287 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-221bbe29-f96d-41e2-bda0-3d1aa3d16a63 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:36.817811 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-221bbe29-f96d-41e2-bda0-3d1aa3d16a63 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:36.818716 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-221bbe29-f96d-41e2-bda0-3d1aa3d16a63 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:36.819312 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-221bbe29-f96d-41e2-bda0-3d1aa3d16a63 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:36.819953 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-221bbe29-f96d-41e2-bda0-3d1aa3d16a63 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:36.968087 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-221bbe29-f96d-41e2-bda0-3d1aa3d16a63 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:36.976668 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-221bbe29-f96d-41e2-bda0-3d1aa3d16a63 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.174351 Aug 12 06:51:36.977285 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 216/436] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:36 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:37.733937 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-855916b2-0b0c-4743-9831-f68fa4817a69 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:37.737351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-855916b2-0b0c-4743-9831-f68fa4817a69 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:37.746166 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-855916b2-0b0c-4743-9831-f68fa4817a69 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:37.746645 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-855916b2-0b0c-4743-9831-f68fa4817a69 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:37.747073 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-855916b2-0b0c-4743-9831-f68fa4817a69 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:37.747789 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-855916b2-0b0c-4743-9831-f68fa4817a69 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:37.748243 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-855916b2-0b0c-4743-9831-f68fa4817a69 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:37.748654 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-855916b2-0b0c-4743-9831-f68fa4817a69 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:37.779677 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-855916b2-0b0c-4743-9831-f68fa4817a69 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052302 Aug 12 06:51:37.780145 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 221/437] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:37 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:38.005709 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d075aea1-d99e-49b1-8917-36b212099494 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:38.006660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d075aea1-d99e-49b1-8917-36b212099494 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:38.014152 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d075aea1-d99e-49b1-8917-36b212099494 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:38.014634 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d075aea1-d99e-49b1-8917-36b212099494 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:38.015088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d075aea1-d99e-49b1-8917-36b212099494 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:38.015774 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d075aea1-d99e-49b1-8917-36b212099494 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:38.016218 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d075aea1-d99e-49b1-8917-36b212099494 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:38.016640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d075aea1-d99e-49b1-8917-36b212099494 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:38.034616 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:38.158052 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d075aea1-d99e-49b1-8917-36b212099494 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:38.166316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d075aea1-d99e-49b1-8917-36b212099494 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.167012 Aug 12 06:51:38.166858 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 217/438] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:37 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:38.796184 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8de6dbe2-c1e4-46bb-bf0f-5b1477c61b29 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:38.799641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8de6dbe2-c1e4-46bb-bf0f-5b1477c61b29 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:38.810435 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8de6dbe2-c1e4-46bb-bf0f-5b1477c61b29 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:38.811296 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8de6dbe2-c1e4-46bb-bf0f-5b1477c61b29 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:38.812014 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8de6dbe2-c1e4-46bb-bf0f-5b1477c61b29 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:38.813152 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8de6dbe2-c1e4-46bb-bf0f-5b1477c61b29 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:38.813898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8de6dbe2-c1e4-46bb-bf0f-5b1477c61b29 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:38.814594 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8de6dbe2-c1e4-46bb-bf0f-5b1477c61b29 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:38.846864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8de6dbe2-c1e4-46bb-bf0f-5b1477c61b29 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057431 Aug 12 06:51:38.847473 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 222/439] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:38 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:39.196501 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cdbdd475-16d2-4bbd-be8b-ba11a394561d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:39.197176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cdbdd475-16d2-4bbd-be8b-ba11a394561d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:39.208018 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cdbdd475-16d2-4bbd-be8b-ba11a394561d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:39.209091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cdbdd475-16d2-4bbd-be8b-ba11a394561d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:39.209091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cdbdd475-16d2-4bbd-be8b-ba11a394561d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:39.209692 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cdbdd475-16d2-4bbd-be8b-ba11a394561d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:39.210209 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cdbdd475-16d2-4bbd-be8b-ba11a394561d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:39.210589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cdbdd475-16d2-4bbd-be8b-ba11a394561d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:39.344205 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cdbdd475-16d2-4bbd-be8b-ba11a394561d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:39.352536 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cdbdd475-16d2-4bbd-be8b-ba11a394561d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.161688 Aug 12 06:51:39.353140 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 218/440] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:39 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:39.863556 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f6e5cc09-d3c7-4aa4-91df-e5ab0812fd12 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:39.867010 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f6e5cc09-d3c7-4aa4-91df-e5ab0812fd12 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:39.877754 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6e5cc09-d3c7-4aa4-91df-e5ab0812fd12 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:39.878545 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6e5cc09-d3c7-4aa4-91df-e5ab0812fd12 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:39.879324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6e5cc09-d3c7-4aa4-91df-e5ab0812fd12 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:39.880547 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6e5cc09-d3c7-4aa4-91df-e5ab0812fd12 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:39.881296 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6e5cc09-d3c7-4aa4-91df-e5ab0812fd12 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:39.881968 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6e5cc09-d3c7-4aa4-91df-e5ab0812fd12 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:39.911998 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f6e5cc09-d3c7-4aa4-91df-e5ab0812fd12 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055230 Aug 12 06:51:39.912549 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 223/441] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:51:39 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 06:51:39.975593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-662d7a34-5cbb-416f-a1ee-9adb8071f576 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:39.976086 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-662d7a34-5cbb-416f-a1ee-9adb8071f576 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:39.982450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662d7a34-5cbb-416f-a1ee-9adb8071f576 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:39.982935 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662d7a34-5cbb-416f-a1ee-9adb8071f576 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:39.983397 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662d7a34-5cbb-416f-a1ee-9adb8071f576 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:39.984090 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662d7a34-5cbb-416f-a1ee-9adb8071f576 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:39.984538 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662d7a34-5cbb-416f-a1ee-9adb8071f576 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:39.984951 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662d7a34-5cbb-416f-a1ee-9adb8071f576 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:40.010656 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-662d7a34-5cbb-416f-a1ee-9adb8071f576 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:51:40.091241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-662d7a34-5cbb-416f-a1ee-9adb8071f576 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 204 len: 0 microversion: 2.1 time: 0.119077 Aug 12 06:51:40.091986 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 219/442] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:51:39 2022] DELETE /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:51:40.100435 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b6b3b638-a714-4dfa-ab09-500243521093 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:40.101143 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b6b3b638-a714-4dfa-ab09-500243521093 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:40.107249 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6b3b638-a714-4dfa-ab09-500243521093 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:40.107732 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6b3b638-a714-4dfa-ab09-500243521093 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:40.108156 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6b3b638-a714-4dfa-ab09-500243521093 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:40.108846 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6b3b638-a714-4dfa-ab09-500243521093 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:40.109290 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6b3b638-a714-4dfa-ab09-500243521093 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:40.109702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6b3b638-a714-4dfa-ab09-500243521093 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:40.244784 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b6b3b638-a714-4dfa-ab09-500243521093 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:40.253638 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b6b3b638-a714-4dfa-ab09-500243521093 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1681 microversion: 2.1 time: 0.156878 Aug 12 06:51:40.254371 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 224/443] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:40 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:40.378498 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b208a142-f62b-4a7c-8d3a-e65e1f5861e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:40.379649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b208a142-f62b-4a7c-8d3a-e65e1f5861e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:40.387641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b208a142-f62b-4a7c-8d3a-e65e1f5861e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:40.388118 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b208a142-f62b-4a7c-8d3a-e65e1f5861e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:40.388542 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b208a142-f62b-4a7c-8d3a-e65e1f5861e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:40.389228 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b208a142-f62b-4a7c-8d3a-e65e1f5861e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:40.389674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b208a142-f62b-4a7c-8d3a-e65e1f5861e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:40.390094 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b208a142-f62b-4a7c-8d3a-e65e1f5861e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:40.520808 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b208a142-f62b-4a7c-8d3a-e65e1f5861e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:40.529016 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b208a142-f62b-4a7c-8d3a-e65e1f5861e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.157415 Aug 12 06:51:40.529582 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 220/444] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:40 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:41.276060 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e2549414-ccbc-4eba-bbaa-8a10b5cd876d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:41.276680 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e2549414-ccbc-4eba-bbaa-8a10b5cd876d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:41.283503 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2549414-ccbc-4eba-bbaa-8a10b5cd876d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:41.283976 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2549414-ccbc-4eba-bbaa-8a10b5cd876d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:41.284398 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2549414-ccbc-4eba-bbaa-8a10b5cd876d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:41.285075 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2549414-ccbc-4eba-bbaa-8a10b5cd876d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:41.285520 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2549414-ccbc-4eba-bbaa-8a10b5cd876d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:41.285934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2549414-ccbc-4eba-bbaa-8a10b5cd876d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:41.549998 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7e1fdc6c-cfb2-4d3e-9449-e0ec22dea040 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:41.550701 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7e1fdc6c-cfb2-4d3e-9449-e0ec22dea040 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:41.558179 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e1fdc6c-cfb2-4d3e-9449-e0ec22dea040 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:41.558664 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e1fdc6c-cfb2-4d3e-9449-e0ec22dea040 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:41.559125 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e1fdc6c-cfb2-4d3e-9449-e0ec22dea040 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:41.559823 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e1fdc6c-cfb2-4d3e-9449-e0ec22dea040 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:41.560268 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e1fdc6c-cfb2-4d3e-9449-e0ec22dea040 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:41.560684 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e1fdc6c-cfb2-4d3e-9449-e0ec22dea040 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:41.675690 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e2549414-ccbc-4eba-bbaa-8a10b5cd876d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:41.684021 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e2549414-ccbc-4eba-bbaa-8a10b5cd876d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1681 microversion: 2.1 time: 0.411783 Aug 12 06:51:41.684592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 225/445] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:41 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1681 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:41.720181 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7e1fdc6c-cfb2-4d3e-9449-e0ec22dea040 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:41.728638 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7e1fdc6c-cfb2-4d3e-9449-e0ec22dea040 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.182574 Aug 12 06:51:41.729207 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 221/446] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:41 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:42.709641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-611628b5-c25b-4cc2-bfee-c81294dfa69b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:42.709641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-611628b5-c25b-4cc2-bfee-c81294dfa69b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:42.720691 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-611628b5-c25b-4cc2-bfee-c81294dfa69b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:42.721307 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-611628b5-c25b-4cc2-bfee-c81294dfa69b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:42.721904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-611628b5-c25b-4cc2-bfee-c81294dfa69b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:42.722945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-611628b5-c25b-4cc2-bfee-c81294dfa69b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:42.723631 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-611628b5-c25b-4cc2-bfee-c81294dfa69b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:42.724257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-611628b5-c25b-4cc2-bfee-c81294dfa69b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:42.749762 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cc2b8edb-1bc8-4421-83a6-6cf0cc046605 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:42.750354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cc2b8edb-1bc8-4421-83a6-6cf0cc046605 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:42.757024 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc2b8edb-1bc8-4421-83a6-6cf0cc046605 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:42.757628 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc2b8edb-1bc8-4421-83a6-6cf0cc046605 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:42.758342 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc2b8edb-1bc8-4421-83a6-6cf0cc046605 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:42.759091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc2b8edb-1bc8-4421-83a6-6cf0cc046605 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:42.759543 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc2b8edb-1bc8-4421-83a6-6cf0cc046605 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:42.759961 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc2b8edb-1bc8-4421-83a6-6cf0cc046605 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:42.904864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-611628b5-c25b-4cc2-bfee-c81294dfa69b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:42.912977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-611628b5-c25b-4cc2-bfee-c81294dfa69b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1681 microversion: 2.1 time: 0.210333 Aug 12 06:51:42.913550 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 226/447] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:42 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:42.929432 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cc2b8edb-1bc8-4421-83a6-6cf0cc046605 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:42.937766 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cc2b8edb-1bc8-4421-83a6-6cf0cc046605 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.191823 Aug 12 06:51:42.938298 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 222/448] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:42 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:43.939529 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3c446e5e-edd1-4455-9249-f22c589face2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:43.940512 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3c446e5e-edd1-4455-9249-f22c589face2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:43.951505 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c446e5e-edd1-4455-9249-f22c589face2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:43.952305 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c446e5e-edd1-4455-9249-f22c589face2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:43.952968 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c446e5e-edd1-4455-9249-f22c589face2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:43.954148 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c446e5e-edd1-4455-9249-f22c589face2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:43.955058 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c446e5e-edd1-4455-9249-f22c589face2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:43.955798 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c446e5e-edd1-4455-9249-f22c589face2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:43.962450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-987879ec-d9b9-4d1e-a446-98df9750a266 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:43.963098 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-987879ec-d9b9-4d1e-a446-98df9750a266 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:43.969771 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-987879ec-d9b9-4d1e-a446-98df9750a266 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:43.970246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-987879ec-d9b9-4d1e-a446-98df9750a266 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:43.970670 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-987879ec-d9b9-4d1e-a446-98df9750a266 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:43.971376 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-987879ec-d9b9-4d1e-a446-98df9750a266 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:43.971834 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-987879ec-d9b9-4d1e-a446-98df9750a266 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:43.972245 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-987879ec-d9b9-4d1e-a446-98df9750a266 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:44.148601 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3c446e5e-edd1-4455-9249-f22c589face2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:44.156430 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3c446e5e-edd1-4455-9249-f22c589face2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1681 microversion: 2.1 time: 0.223377 Aug 12 06:51:44.157867 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 227/449] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:43 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:44.159795 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-987879ec-d9b9-4d1e-a446-98df9750a266 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:44.168969 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-987879ec-d9b9-4d1e-a446-98df9750a266 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.212356 Aug 12 06:51:44.169627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 223/450] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:43 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:45.181295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b5e08113-fe94-4331-8eac-cda94cfcc4d4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:45.181917 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b5e08113-fe94-4331-8eac-cda94cfcc4d4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:45.189413 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5e08113-fe94-4331-8eac-cda94cfcc4d4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:45.189928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-615a78ba-24b4-4497-b651-2aadf94d0700 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:45.190402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5e08113-fe94-4331-8eac-cda94cfcc4d4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:45.190402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5e08113-fe94-4331-8eac-cda94cfcc4d4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:45.190598 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-615a78ba-24b4-4497-b651-2aadf94d0700 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:45.191179 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5e08113-fe94-4331-8eac-cda94cfcc4d4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:45.191667 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5e08113-fe94-4331-8eac-cda94cfcc4d4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:45.192126 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5e08113-fe94-4331-8eac-cda94cfcc4d4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:45.197922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-615a78ba-24b4-4497-b651-2aadf94d0700 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:45.198458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-615a78ba-24b4-4497-b651-2aadf94d0700 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:45.198928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-615a78ba-24b4-4497-b651-2aadf94d0700 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:45.199731 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-615a78ba-24b4-4497-b651-2aadf94d0700 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:45.200225 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-615a78ba-24b4-4497-b651-2aadf94d0700 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:45.200686 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-615a78ba-24b4-4497-b651-2aadf94d0700 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:45.388906 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b5e08113-fe94-4331-8eac-cda94cfcc4d4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:45.391279 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:45.393126 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-615a78ba-24b4-4497-b651-2aadf94d0700 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:45.398455 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b5e08113-fe94-4331-8eac-cda94cfcc4d4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1681 microversion: 2.1 time: 0.222937 Aug 12 06:51:45.402432 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-615a78ba-24b4-4497-b651-2aadf94d0700 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.216614 Aug 12 06:51:45.403475 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 224/451] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:45 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:45.404191 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 228/452] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:45 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:46.427054 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c5d052d2-9a8f-4f80-adde-4af493a2f049 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:46.428166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c5d052d2-9a8f-4f80-adde-4af493a2f049 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:46.429727 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-af20c42d-8f93-437b-9267-3dc8cb87811c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:46.430727 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-af20c42d-8f93-437b-9267-3dc8cb87811c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:46.440818 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5d052d2-9a8f-4f80-adde-4af493a2f049 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:46.441648 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5d052d2-9a8f-4f80-adde-4af493a2f049 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:46.442347 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5d052d2-9a8f-4f80-adde-4af493a2f049 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:46.442923 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af20c42d-8f93-437b-9267-3dc8cb87811c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:46.443528 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5d052d2-9a8f-4f80-adde-4af493a2f049 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:46.443764 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af20c42d-8f93-437b-9267-3dc8cb87811c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:46.444275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5d052d2-9a8f-4f80-adde-4af493a2f049 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:46.444549 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af20c42d-8f93-437b-9267-3dc8cb87811c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:46.444975 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5d052d2-9a8f-4f80-adde-4af493a2f049 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:46.445583 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af20c42d-8f93-437b-9267-3dc8cb87811c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:46.446017 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af20c42d-8f93-437b-9267-3dc8cb87811c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:46.446447 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af20c42d-8f93-437b-9267-3dc8cb87811c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:46.638133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af20c42d-8f93-437b-9267-3dc8cb87811c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:46.640987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c5d052d2-9a8f-4f80-adde-4af493a2f049 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:46.646674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-af20c42d-8f93-437b-9267-3dc8cb87811c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.225216 Aug 12 06:51:46.647279 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 229/453] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:46 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:46.648970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c5d052d2-9a8f-4f80-adde-4af493a2f049 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1681 microversion: 2.1 time: 0.231178 Aug 12 06:51:46.649519 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 225/454] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:46 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1681 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:47.667565 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f8bff12e-dbd2-4b03-ad20-716501e085cd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:47.668146 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f8bff12e-dbd2-4b03-ad20-716501e085cd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:47.673354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-79f1141d-df70-44e2-8ded-04410a35426a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:47.674032 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-79f1141d-df70-44e2-8ded-04410a35426a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:47.680304 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79f1141d-df70-44e2-8ded-04410a35426a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:47.684383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79f1141d-df70-44e2-8ded-04410a35426a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:47.688041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8bff12e-dbd2-4b03-ad20-716501e085cd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:47.688614 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79f1141d-df70-44e2-8ded-04410a35426a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:47.689133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8bff12e-dbd2-4b03-ad20-716501e085cd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:47.690175 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79f1141d-df70-44e2-8ded-04410a35426a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:47.690617 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8bff12e-dbd2-4b03-ad20-716501e085cd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:47.691622 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8bff12e-dbd2-4b03-ad20-716501e085cd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:47.692305 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79f1141d-df70-44e2-8ded-04410a35426a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:47.692696 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79f1141d-df70-44e2-8ded-04410a35426a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:47.698204 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8bff12e-dbd2-4b03-ad20-716501e085cd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:47.698861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8bff12e-dbd2-4b03-ad20-716501e085cd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:47.974799 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f8bff12e-dbd2-4b03-ad20-716501e085cd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:47.982251 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-79f1141d-df70-44e2-8ded-04410a35426a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:47.983252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f8bff12e-dbd2-4b03-ad20-716501e085cd tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.319607 Aug 12 06:51:47.983802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 230/455] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:47 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:47.990684 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-79f1141d-df70-44e2-8ded-04410a35426a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1681 microversion: 2.1 time: 0.321088 Aug 12 06:51:47.991173 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 226/456] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:47 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1681 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:48.347929 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-31f032be-a76b-4f60-87dd-c4868e5f3639 req-0db12153-c74b-4fd7-9fed-da53b46a47c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5e7e6c-f576-47c1-8fb5-407e318d15c4", "name": "network-vif-deleted", "tag": "27e18af9-c038-4192-b7a5-a893995402b0"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:51:48.359724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-31f032be-a76b-4f60-87dd-c4868e5f3639 req-0db12153-c74b-4fd7-9fed-da53b46a47c8 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:48.360190 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-31f032be-a76b-4f60-87dd-c4868e5f3639 req-0db12153-c74b-4fd7-9fed-da53b46a47c8 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:48.360610 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-31f032be-a76b-4f60-87dd-c4868e5f3639 req-0db12153-c74b-4fd7-9fed-da53b46a47c8 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:48.373394 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-31f032be-a76b-4f60-87dd-c4868e5f3639 req-0db12153-c74b-4fd7-9fed-da53b46a47c8 service nova] Creating event network-vif-deleted:27e18af9-c038-4192-b7a5-a893995402b0 for instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 on hv-cinder-84457 Aug 12 06:51:48.378589 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-31f032be-a76b-4f60-87dd-c4868e5f3639 req-0db12153-c74b-4fd7-9fed-da53b46a47c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034411 Aug 12 06:51:48.379208 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 231/457] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:49.005185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b197ab7d-2d02-4b49-855b-423d36b2d1a4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:49.006484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b197ab7d-2d02-4b49-855b-423d36b2d1a4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:49.012383 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-01e1ded5-d298-4ec2-8573-bdf9163c2f53 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:49.013410 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b197ab7d-2d02-4b49-855b-423d36b2d1a4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:49.013634 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-01e1ded5-d298-4ec2-8573-bdf9163c2f53 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:49.013870 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b197ab7d-2d02-4b49-855b-423d36b2d1a4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:49.014331 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b197ab7d-2d02-4b49-855b-423d36b2d1a4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:49.015093 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b197ab7d-2d02-4b49-855b-423d36b2d1a4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:49.015535 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b197ab7d-2d02-4b49-855b-423d36b2d1a4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:49.016280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b197ab7d-2d02-4b49-855b-423d36b2d1a4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:49.022561 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e1ded5-d298-4ec2-8573-bdf9163c2f53 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:49.023128 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e1ded5-d298-4ec2-8573-bdf9163c2f53 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:49.023579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e1ded5-d298-4ec2-8573-bdf9163c2f53 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:49.024343 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e1ded5-d298-4ec2-8573-bdf9163c2f53 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:49.024867 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e1ded5-d298-4ec2-8573-bdf9163c2f53 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:49.025286 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e1ded5-d298-4ec2-8573-bdf9163c2f53 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:49.103556 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-01e1ded5-d298-4ec2-8573-bdf9163c2f53 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:49.113377 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-01e1ded5-d298-4ec2-8573-bdf9163c2f53 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1613 microversion: 2.1 time: 0.105062 Aug 12 06:51:49.124471 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 232/458] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:49 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1613 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:49.173029 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b197ab7d-2d02-4b49-855b-423d36b2d1a4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:49.181605 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b197ab7d-2d02-4b49-855b-423d36b2d1a4 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.180315 Aug 12 06:51:49.182176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 227/459] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:49 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:50.139801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2090d4c2-1034-4631-a775-7d123d099926 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:50.140700 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2090d4c2-1034-4631-a775-7d123d099926 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:50.151849 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2090d4c2-1034-4631-a775-7d123d099926 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:50.152641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2090d4c2-1034-4631-a775-7d123d099926 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:50.153351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2090d4c2-1034-4631-a775-7d123d099926 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:50.154451 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2090d4c2-1034-4631-a775-7d123d099926 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:50.155265 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2090d4c2-1034-4631-a775-7d123d099926 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:50.155960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2090d4c2-1034-4631-a775-7d123d099926 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:50.202797 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-dc64307d-fc5e-4a5c-b61b-6cf90e2ebdc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:50.203454 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-dc64307d-fc5e-4a5c-b61b-6cf90e2ebdc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:50.210292 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc64307d-fc5e-4a5c-b61b-6cf90e2ebdc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:50.210768 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc64307d-fc5e-4a5c-b61b-6cf90e2ebdc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:50.211232 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc64307d-fc5e-4a5c-b61b-6cf90e2ebdc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:50.211920 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc64307d-fc5e-4a5c-b61b-6cf90e2ebdc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:50.212360 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc64307d-fc5e-4a5c-b61b-6cf90e2ebdc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:50.212770 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc64307d-fc5e-4a5c-b61b-6cf90e2ebdc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:50.229429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2090d4c2-1034-4631-a775-7d123d099926 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:50.238864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2090d4c2-1034-4631-a775-7d123d099926 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1325 microversion: 2.1 time: 0.105602 Aug 12 06:51:50.239490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 233/460] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:50 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1325 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:50.351240 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dc64307d-fc5e-4a5c-b61b-6cf90e2ebdc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:50.359471 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-dc64307d-fc5e-4a5c-b61b-6cf90e2ebdc7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.160471 Aug 12 06:51:50.360033 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 228/461] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:50 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:51.261494 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:51.262566 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:51.265737 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=55 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:51.272031 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:51.272503 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:51.272922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:51.273642 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:51.274086 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:51.274510 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:51.312514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:51.312992 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:51.313419 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:51.313852 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lazy-loading 'fault' on Instance uuid 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:51:51.357982 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:51.365682 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-46a95331-e9a2-44e3-baef-8c1aac3a5022 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 200 len: 1330 microversion: 2.1 time: 0.108782 Aug 12 06:51:51.366434 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 234/462] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:51 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:51.381982 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-473ea015-da7f-4b30-bcb7-1781db2bee2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:51.382642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-473ea015-da7f-4b30-bcb7-1781db2bee2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:51.385904 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:51.392091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-473ea015-da7f-4b30-bcb7-1781db2bee2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:51.392589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-473ea015-da7f-4b30-bcb7-1781db2bee2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:51.393013 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-473ea015-da7f-4b30-bcb7-1781db2bee2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:51.393693 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-473ea015-da7f-4b30-bcb7-1781db2bee2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:51.394136 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-473ea015-da7f-4b30-bcb7-1781db2bee2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:51.394544 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-473ea015-da7f-4b30-bcb7-1781db2bee2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:51.532745 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-473ea015-da7f-4b30-bcb7-1781db2bee2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:51.542028 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-473ea015-da7f-4b30-bcb7-1781db2bee2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.165159 Aug 12 06:51:51.542630 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 229/463] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:51 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:52.390404 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:52.391219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:52.401528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:52.402264 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:52.402929 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:52.404027 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:52.404717 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:52.405347 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:52.422188 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 HTTP/1.1 Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:51:52.423935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:51:52.425392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '7d5e7e6c-f576-47c1-8fb5-407e318d15c4'} Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:51:52.426197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:51:52.427656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:52.428897 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:51:52.428897 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d5863bef-cdc1-419b-a62a-89bd91a24838 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 404 len: 111 microversion: 2.1 time: 0.040965 Aug 12 06:51:52.428897 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 235/464] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:52 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:51:52.436774 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e81c572d-1a1c-4b93-a184-d1715603cb59 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '.version_select at 0x7fc704623430>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:52.460288 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e81c572d-1a1c-4b93-a184-d1715603cb59 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-433145148" status: 202 len: 0 microversion: 2.1 time: 0.029442 Aug 12 06:51:52.460852 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 230/465] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Aug 12 06:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-433145148 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:51:52.563592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2ba9b1cf-6bac-4e5b-be40-5fc37aaa4355 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:52.564189 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2ba9b1cf-6bac-4e5b-be40-5fc37aaa4355 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:52.570465 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ba9b1cf-6bac-4e5b-be40-5fc37aaa4355 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:52.570945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ba9b1cf-6bac-4e5b-be40-5fc37aaa4355 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:52.571391 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ba9b1cf-6bac-4e5b-be40-5fc37aaa4355 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:52.572060 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ba9b1cf-6bac-4e5b-be40-5fc37aaa4355 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:52.572504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ba9b1cf-6bac-4e5b-be40-5fc37aaa4355 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:52.572913 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ba9b1cf-6bac-4e5b-be40-5fc37aaa4355 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:52.795612 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2ba9b1cf-6bac-4e5b-be40-5fc37aaa4355 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:52.804056 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2ba9b1cf-6bac-4e5b-be40-5fc37aaa4355 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.244295 Aug 12 06:51:52.804564 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 236/466] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:52 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:53.210932 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cce51516-4dd0-47fa-ba87-daa77e5a6278 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: .version_select at 0x7fc70460fdc0>, body: {"keypair": {"name": "tempest-keypair-1595662481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnjy/huqR5inpQFn6ERs4yfTh89+lXoTdBf5cfOi66Ef1HvA2R/22JF4UdsGXW0/DkIgu9aYVoS37JXnCYM+o4Cr6Qmx9UEUqp2aibpZqHzPUbp9hRvb+rnQ2wkdqVEWg=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:51:53.232314 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-cce51516-4dd0-47fa-ba87-daa77e5a6278 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for project b89f418ef5fd41b39c0a0a36968da428. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:51:53.239919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-cce51516-4dd0-47fa-ba87-daa77e5a6278 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for user 342ef719c63d4fbfa5a2a3943bd3b24b and project b89f418ef5fd41b39c0a0a36968da428. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:51:53.267284 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cce51516-4dd0-47fa-ba87-daa77e5a6278 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060175 Aug 12 06:51:53.267872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 231/467] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 06:51:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:51:53.826352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-adcc5ed7-ee56-410b-99b1-0ec16245e3d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:53.827126 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-adcc5ed7-ee56-410b-99b1-0ec16245e3d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:53.833884 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adcc5ed7-ee56-410b-99b1-0ec16245e3d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:53.834357 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adcc5ed7-ee56-410b-99b1-0ec16245e3d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:53.834797 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adcc5ed7-ee56-410b-99b1-0ec16245e3d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:53.835553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adcc5ed7-ee56-410b-99b1-0ec16245e3d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:53.836021 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adcc5ed7-ee56-410b-99b1-0ec16245e3d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:53.836437 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adcc5ed7-ee56-410b-99b1-0ec16245e3d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:53.967742 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-adcc5ed7-ee56-410b-99b1-0ec16245e3d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:53.975860 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-adcc5ed7-ee56-410b-99b1-0ec16245e3d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1735 microversion: 2.1 time: 0.153446 Aug 12 06:51:53.976447 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 237/468] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:53 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:54.579715 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1832132939", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f384a833-4d30-4845-aa83-a1cad46c6a6b"}], "security_groups": [{"name": "tempest-securitygroup--730331112"}], "key_name": "tempest-keypair-1595662481", "user_data": "}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:51:54.685609 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] validate_networks() for [('f384a833-4d30-4845-aa83-a1cad46c6a6b', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:51:54.998148 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-407dc010-551f-48d3-a4ce-3d9e581392cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:55.000352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-407dc010-551f-48d3-a4ce-3d9e581392cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:55.007186 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407dc010-551f-48d3-a4ce-3d9e581392cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.008566 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407dc010-551f-48d3-a4ce-3d9e581392cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.009007 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407dc010-551f-48d3-a4ce-3d9e581392cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.009815 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407dc010-551f-48d3-a4ce-3d9e581392cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.010557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407dc010-551f-48d3-a4ce-3d9e581392cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.011199 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407dc010-551f-48d3-a4ce-3d9e581392cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.066606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:51:55.067353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:51:55.068021 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:51:55.068416 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:51:55.068778 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:51:55.079044 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.079501 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.079926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.080666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.081321 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.081771 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.099409 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for project b89f418ef5fd41b39c0a0a36968da428. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:51:55.103535 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for user 342ef719c63d4fbfa5a2a3943bd3b24b and project b89f418ef5fd41b39c0a0a36968da428. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:51:55.114749 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:51:55.117141 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:51:55.153691 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-407dc010-551f-48d3-a4ce-3d9e581392cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:55.161725 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-407dc010-551f-48d3-a4ce-3d9e581392cf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1715 microversion: 2.1 time: 0.167951 Aug 12 06:51:55.162296 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 238/469] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:54 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:55.162877 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-eadf5706-2c21-4a8c-b3e0-df675eb879db tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.587592 Aug 12 06:51:55.163728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 232/470] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:51:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:51:55.178801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9028c441-eb08-46c4-88d4-800ab9d34d81 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:55.179491 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9028c441-eb08-46c4-88d4-800ab9d34d81 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:55.234749 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9028c441-eb08-46c4-88d4-800ab9d34d81 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:55.242342 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9028c441-eb08-46c4-88d4-800ab9d34d81 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1242 microversion: 2.1 time: 0.067266 Aug 12 06:51:55.242913 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 239/471] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:55 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:55.283867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d5f2c2cb-0fa5-4fc1-bec5-e68b41d31b00 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:55.284595 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d5f2c2cb-0fa5-4fc1-bec5-e68b41d31b00 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:55.292106 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f2c2cb-0fa5-4fc1-bec5-e68b41d31b00 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.293706 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f2c2cb-0fa5-4fc1-bec5-e68b41d31b00 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.294743 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f2c2cb-0fa5-4fc1-bec5-e68b41d31b00 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.295696 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f2c2cb-0fa5-4fc1-bec5-e68b41d31b00 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.296350 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f2c2cb-0fa5-4fc1-bec5-e68b41d31b00 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.297363 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f2c2cb-0fa5-4fc1-bec5-e68b41d31b00 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.301684 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:55.302175 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:55.308194 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.308743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.309133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.309758 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.310378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.310799 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.424479 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] HTTP exception thrown: Cannot 'detach_volume' instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 while it is in vm_state rescued Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Request method failure captured: Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments/7f538766-788b-4247-ae2f-37f4d803bdbb HTTP/1.1 Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9feYq1WRxO1Mn164rhUCBzm3LFDxqEbHN0rZaCFppVUvY401Qo_9blAqxE1jSwnwng7ImaGb5PIbVbYQeOFbAubwTc9U1tEAi7xvUnwMVElhSMnvIl7Uh5962LmQALoPj8xHxamxpdP9xZrB6QoQdnWuhnf8Qeu0j7Yg5UC9bC_VafY Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 9871a1ac34bd4164bd662499cf299cbe Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:51:55.426147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:51:55.427500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9871a1ac34bd4164bd662499cf299cbe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:51:55.427500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:51:55.427500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 9871a1ac34bd4164bd662499cf299cbe Aug 12 06:51:55.427500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:51:55.427500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-ServerRescueNegativeTestJSON-1861263750-project Aug 12 06:51:55.427500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:51:55.427500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:51:55.427500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: cf53f022a26d48b3aa70cea4f5fbc1c3 Aug 12 06:51:55.427500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1861263750-project Aug 12 06:51:55.427500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:51:55.427500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Cannot 'detach_volume' instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 while it is in vm_state rescued Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'server_id': '1f1d2c7f-0786-4d54-8a52-d1d3deac1f29', 'id': '7f538766-788b-4247-ae2f-37f4d803bdbb'} Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:51:55.428170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 while it is in vm_state rescued Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 while it is in vm_state rescued Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:51:55.429341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Returning 409 to user: Cannot 'detach_volume' instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 while it is in vm_state rescued {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:51:55.430950 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f4964970-647b-43d9-af8e-9777d2fdfb9f tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments/7f538766-788b-4247-ae2f-37f4d803bdbb" status: 409 len: 152 microversion: 2.1 time: 0.130307 Aug 12 06:51:55.430950 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 240/472] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:51:55 2022] DELETE /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments/7f538766-788b-4247-ae2f-37f4d803bdbb => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 12 06:51:55.435202 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-d5f2c2cb-0fa5-4fc1-bec5-e68b41d31b00 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lazy-loading 'services' on Instance uuid bf06507b-28e3-41f2-ac29-84475ca09baa {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:51:55.439855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-252aa650-f303-4ad4-9bd5-4d8845612b74 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:51:55.440383 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-252aa650-f303-4ad4-9bd5-4d8845612b74 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:55.446877 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-252aa650-f303-4ad4-9bd5-4d8845612b74 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.447431 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-252aa650-f303-4ad4-9bd5-4d8845612b74 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.447827 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-252aa650-f303-4ad4-9bd5-4d8845612b74 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.448835 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-252aa650-f303-4ad4-9bd5-4d8845612b74 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.449552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-252aa650-f303-4ad4-9bd5-4d8845612b74 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.450144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-252aa650-f303-4ad4-9bd5-4d8845612b74 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.541786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-252aa650-f303-4ad4-9bd5-4d8845612b74 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "POST /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/action" status: 202 len: 0 microversion: 2.1 time: 0.105817 Aug 12 06:51:55.543008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 241/473] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:51:55 2022] POST /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 06:51:55.554400 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e08832cd-0b29-421f-bb35-ddca81c5a8ae tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:55.555058 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e08832cd-0b29-421f-bb35-ddca81c5a8ae tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:55.561726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e08832cd-0b29-421f-bb35-ddca81c5a8ae tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.562317 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e08832cd-0b29-421f-bb35-ddca81c5a8ae tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.562899 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e08832cd-0b29-421f-bb35-ddca81c5a8ae tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.563684 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e08832cd-0b29-421f-bb35-ddca81c5a8ae tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:55.564178 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e08832cd-0b29-421f-bb35-ddca81c5a8ae tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:55.564686 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e08832cd-0b29-421f-bb35-ddca81c5a8ae tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:55.574005 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d5f2c2cb-0fa5-4fc1-bec5-e68b41d31b00 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa/os-volume_attachments/f5058735-b9aa-4ba4-b270-eba2f2508fff" status: 202 len: 0 microversion: 2.1 time: 0.293868 Aug 12 06:51:55.575078 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 233/474] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:51:55 2022] DELETE /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa/os-volume_attachments/f5058735-b9aa-4ba4-b270-eba2f2508fff => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:51:55.728250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e08832cd-0b29-421f-bb35-ddca81c5a8ae tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:55.736819 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e08832cd-0b29-421f-bb35-ddca81c5a8ae tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1723 microversion: 2.1 time: 0.187771 Aug 12 06:51:55.737376 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 242/475] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:55 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:56.267701 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a8c29e87-56a7-4a2a-8131-b2a4a3449ff5 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:56.268388 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a8c29e87-56a7-4a2a-8131-b2a4a3449ff5 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:56.278633 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8c29e87-56a7-4a2a-8131-b2a4a3449ff5 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:56.279349 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8c29e87-56a7-4a2a-8131-b2a4a3449ff5 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:56.279945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8c29e87-56a7-4a2a-8131-b2a4a3449ff5 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:56.280959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8c29e87-56a7-4a2a-8131-b2a4a3449ff5 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:56.281555 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8c29e87-56a7-4a2a-8131-b2a4a3449ff5 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:56.282036 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8c29e87-56a7-4a2a-8131-b2a4a3449ff5 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:56.301546 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:56.356407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a8c29e87-56a7-4a2a-8131-b2a4a3449ff5 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:56.363938 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a8c29e87-56a7-4a2a-8131-b2a4a3449ff5 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1238 microversion: 2.1 time: 0.103466 Aug 12 06:51:56.364502 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 234/476] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:56 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1238 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:56.759426 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5b61b498-2453-481b-afb0-5125910e0952 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:56.760034 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5b61b498-2453-481b-afb0-5125910e0952 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:56.766595 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b61b498-2453-481b-afb0-5125910e0952 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:56.767116 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b61b498-2453-481b-afb0-5125910e0952 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:56.767544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b61b498-2453-481b-afb0-5125910e0952 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:56.768229 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b61b498-2453-481b-afb0-5125910e0952 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:56.768675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b61b498-2453-481b-afb0-5125910e0952 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:56.769095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b61b498-2453-481b-afb0-5125910e0952 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:56.934449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5b61b498-2453-481b-afb0-5125910e0952 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:56.946340 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5b61b498-2453-481b-afb0-5125910e0952 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1723 microversion: 2.1 time: 0.191021 Aug 12 06:51:56.946905 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 243/477] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:56 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:57.394945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a54f48d3-d26a-4580-b527-405e236fc137 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:57.396025 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a54f48d3-d26a-4580-b527-405e236fc137 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:57.404070 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a54f48d3-d26a-4580-b527-405e236fc137 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:57.404987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a54f48d3-d26a-4580-b527-405e236fc137 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:57.405636 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a54f48d3-d26a-4580-b527-405e236fc137 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:57.406590 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a54f48d3-d26a-4580-b527-405e236fc137 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:57.407493 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a54f48d3-d26a-4580-b527-405e236fc137 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:57.408525 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a54f48d3-d26a-4580-b527-405e236fc137 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:57.548802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a54f48d3-d26a-4580-b527-405e236fc137 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:57.560075 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a54f48d3-d26a-4580-b527-405e236fc137 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1312 microversion: 2.1 time: 0.169293 Aug 12 06:51:57.560692 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 235/478] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:57 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:57.771930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-407c5170-54c5-47f1-a799-6bcc2971e767 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:57.772491 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-407c5170-54c5-47f1-a799-6bcc2971e767 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:57.779754 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407c5170-54c5-47f1-a799-6bcc2971e767 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:57.780296 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407c5170-54c5-47f1-a799-6bcc2971e767 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:57.780774 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407c5170-54c5-47f1-a799-6bcc2971e767 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:57.781483 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407c5170-54c5-47f1-a799-6bcc2971e767 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:57.781985 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407c5170-54c5-47f1-a799-6bcc2971e767 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:57.782406 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-407c5170-54c5-47f1-a799-6bcc2971e767 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:57.809563 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-407c5170-54c5-47f1-a799-6bcc2971e767 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:51:57.865326 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:51:57.898086 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-407c5170-54c5-47f1-a799-6bcc2971e767 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 204 len: 0 microversion: 2.1 time: 0.130248 Aug 12 06:51:57.898784 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 244/479] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:51:57 2022] DELETE /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 12 06:51:57.907395 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-403b464a-0456-4d8b-a753-08428eeec674 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:57.908401 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-403b464a-0456-4d8b-a753-08428eeec674 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:57.916320 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-403b464a-0456-4d8b-a753-08428eeec674 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:57.917497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-403b464a-0456-4d8b-a753-08428eeec674 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:57.918161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-403b464a-0456-4d8b-a753-08428eeec674 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:57.919303 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-403b464a-0456-4d8b-a753-08428eeec674 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:57.919843 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-403b464a-0456-4d8b-a753-08428eeec674 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:57.920514 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-403b464a-0456-4d8b-a753-08428eeec674 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:57.968287 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-df14b591-c30e-4df2-a68b-09b1dcc5009c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:57.969078 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-df14b591-c30e-4df2-a68b-09b1dcc5009c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:57.975277 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df14b591-c30e-4df2-a68b-09b1dcc5009c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:57.975762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df14b591-c30e-4df2-a68b-09b1dcc5009c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:57.976229 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df14b591-c30e-4df2-a68b-09b1dcc5009c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:57.976918 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df14b591-c30e-4df2-a68b-09b1dcc5009c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:57.977365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df14b591-c30e-4df2-a68b-09b1dcc5009c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:57.977948 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df14b591-c30e-4df2-a68b-09b1dcc5009c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:58.093623 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-403b464a-0456-4d8b-a753-08428eeec674 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:58.101919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-403b464a-0456-4d8b-a753-08428eeec674 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1514 microversion: 2.1 time: 0.198626 Aug 12 06:51:58.102499 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 236/480] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:57 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:58.136387 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-27fcc9f9-aa15-4592-b0cd-2a1ad88a12f4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:58.136973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-27fcc9f9-aa15-4592-b0cd-2a1ad88a12f4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:58.143062 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-27fcc9f9-aa15-4592-b0cd-2a1ad88a12f4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:58.143871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-27fcc9f9-aa15-4592-b0cd-2a1ad88a12f4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:58.144476 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-27fcc9f9-aa15-4592-b0cd-2a1ad88a12f4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:58.145688 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-27fcc9f9-aa15-4592-b0cd-2a1ad88a12f4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:58.146294 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-27fcc9f9-aa15-4592-b0cd-2a1ad88a12f4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:58.147086 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-27fcc9f9-aa15-4592-b0cd-2a1ad88a12f4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:58.156176 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-df14b591-c30e-4df2-a68b-09b1dcc5009c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:58.164353 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-df14b591-c30e-4df2-a68b-09b1dcc5009c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1723 microversion: 2.1 time: 0.200436 Aug 12 06:51:58.177989 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 245/481] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:57 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:51:58.231070 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-27fcc9f9-aa15-4592-b0cd-2a1ad88a12f4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lazy-loading 'services' on Instance uuid 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:51:58.310206 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-27fcc9f9-aa15-4592-b0cd-2a1ad88a12f4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/os-volume_attachments/5ec80d7a-dfba-4b8d-a56c-dad44adb19d1" status: 202 len: 0 microversion: 2.1 time: 0.177883 Aug 12 06:51:58.310802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 237/482] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:51:58 2022] DELETE /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/os-volume_attachments/5ec80d7a-dfba-4b8d-a56c-dad44adb19d1 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 06:51:58.584303 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5b997d38-0746-4d26-83d6-a72b734f77c2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:58.585120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5b997d38-0746-4d26-83d6-a72b734f77c2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:58.593861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b997d38-0746-4d26-83d6-a72b734f77c2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:58.594255 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b997d38-0746-4d26-83d6-a72b734f77c2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:58.594807 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b997d38-0746-4d26-83d6-a72b734f77c2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:58.595830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b997d38-0746-4d26-83d6-a72b734f77c2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:58.596443 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b997d38-0746-4d26-83d6-a72b734f77c2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:58.597007 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b997d38-0746-4d26-83d6-a72b734f77c2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:58.744490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5b997d38-0746-4d26-83d6-a72b734f77c2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:58.755927 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5b997d38-0746-4d26-83d6-a72b734f77c2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.177464 Aug 12 06:51:58.756748 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 246/483] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:58 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:59.124924 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e6e7b036-0f46-4f10-8aa9-c301543ff6ed tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:59.125661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e6e7b036-0f46-4f10-8aa9-c301543ff6ed tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:59.132271 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6e7b036-0f46-4f10-8aa9-c301543ff6ed tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:59.132753 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6e7b036-0f46-4f10-8aa9-c301543ff6ed tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:59.133177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6e7b036-0f46-4f10-8aa9-c301543ff6ed tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:59.133838 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6e7b036-0f46-4f10-8aa9-c301543ff6ed tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:59.134304 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6e7b036-0f46-4f10-8aa9-c301543ff6ed tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:59.134713 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6e7b036-0f46-4f10-8aa9-c301543ff6ed tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:59.185775 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-724d049f-36c8-4097-a3e8-18c0fb86b978 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:59.186340 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-724d049f-36c8-4097-a3e8-18c0fb86b978 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:59.192882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-724d049f-36c8-4097-a3e8-18c0fb86b978 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:59.193359 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-724d049f-36c8-4097-a3e8-18c0fb86b978 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:59.193784 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-724d049f-36c8-4097-a3e8-18c0fb86b978 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:59.194461 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-724d049f-36c8-4097-a3e8-18c0fb86b978 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:59.195125 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-724d049f-36c8-4097-a3e8-18c0fb86b978 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:59.195539 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-724d049f-36c8-4097-a3e8-18c0fb86b978 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:59.304867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e6e7b036-0f46-4f10-8aa9-c301543ff6ed tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:59.313295 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e6e7b036-0f46-4f10-8aa9-c301543ff6ed tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1514 microversion: 2.1 time: 0.193130 Aug 12 06:51:59.313985 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 238/484] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:59 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:51:59.348377 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-724d049f-36c8-4097-a3e8-18c0fb86b978 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:59.356610 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-724d049f-36c8-4097-a3e8-18c0fb86b978 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1723 microversion: 2.1 time: 0.174741 Aug 12 06:51:59.357186 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 247/485] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:59 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:51:59.777361 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f5a6b7be-9604-493f-981b-682b9a0114a3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:51:59.777923 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f5a6b7be-9604-493f-981b-682b9a0114a3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:51:59.784023 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a6b7be-9604-493f-981b-682b9a0114a3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:59.784504 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a6b7be-9604-493f-981b-682b9a0114a3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:59.784939 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a6b7be-9604-493f-981b-682b9a0114a3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:59.785626 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a6b7be-9604-493f-981b-682b9a0114a3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:51:59.786067 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a6b7be-9604-493f-981b-682b9a0114a3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:51:59.786487 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a6b7be-9604-493f-981b-682b9a0114a3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:51:59.915418 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f5a6b7be-9604-493f-981b-682b9a0114a3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:51:59.923089 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f5a6b7be-9604-493f-981b-682b9a0114a3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.149572 Aug 12 06:51:59.923693 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 239/486] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:51:59 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:00.190080 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-0fc9039b-b646-4c5a-be4e-c2f15b96e5a5 req-e559a9ab-201b-477d-b961-7730660f5bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337150f7-22b7-4d35-9da2-df74b549b5b2", "tag": "0692b8e8-530a-4198-b110-0f594f201062"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:00.200042 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0fc9039b-b646-4c5a-be4e-c2f15b96e5a5 req-e559a9ab-201b-477d-b961-7730660f5bc4 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:00.200584 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0fc9039b-b646-4c5a-be4e-c2f15b96e5a5 req-e559a9ab-201b-477d-b961-7730660f5bc4 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:00.201130 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0fc9039b-b646-4c5a-be4e-c2f15b96e5a5 req-e559a9ab-201b-477d-b961-7730660f5bc4 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:00.211763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-0fc9039b-b646-4c5a-be4e-c2f15b96e5a5 req-e559a9ab-201b-477d-b961-7730660f5bc4 service nova] Creating event network-changed:0692b8e8-530a-4198-b110-0f594f201062 for instance 337150f7-22b7-4d35-9da2-df74b549b5b2 on hv-cinder-84457 Aug 12 06:52:00.216549 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-0fc9039b-b646-4c5a-be4e-c2f15b96e5a5 req-e559a9ab-201b-477d-b961-7730660f5bc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030234 Aug 12 06:52:00.217167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 248/487] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:00.335430 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-49fe9e1f-685f-4098-8ed9-1334c75cd269 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:00.336038 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-49fe9e1f-685f-4098-8ed9-1334c75cd269 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:00.343081 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-49fe9e1f-685f-4098-8ed9-1334c75cd269 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:00.343558 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-49fe9e1f-685f-4098-8ed9-1334c75cd269 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:00.344032 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-49fe9e1f-685f-4098-8ed9-1334c75cd269 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:00.344722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-49fe9e1f-685f-4098-8ed9-1334c75cd269 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:00.345155 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-49fe9e1f-685f-4098-8ed9-1334c75cd269 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:00.346483 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-49fe9e1f-685f-4098-8ed9-1334c75cd269 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:00.378428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c7769e34-240f-49c6-9794-287e15cdbe6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:00.379133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c7769e34-240f-49c6-9794-287e15cdbe6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:00.386173 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7769e34-240f-49c6-9794-287e15cdbe6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:00.386717 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7769e34-240f-49c6-9794-287e15cdbe6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:00.387370 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7769e34-240f-49c6-9794-287e15cdbe6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:00.388405 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7769e34-240f-49c6-9794-287e15cdbe6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:00.389003 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7769e34-240f-49c6-9794-287e15cdbe6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:00.389597 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7769e34-240f-49c6-9794-287e15cdbe6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:00.543444 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-49fe9e1f-685f-4098-8ed9-1334c75cd269 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:00.554126 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-49fe9e1f-685f-4098-8ed9-1334c75cd269 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1514 microversion: 2.1 time: 0.222274 Aug 12 06:52:00.554961 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 240/488] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:00 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:00.582778 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c7769e34-240f-49c6-9794-287e15cdbe6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:00.591220 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c7769e34-240f-49c6-9794-287e15cdbe6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1723 microversion: 2.1 time: 0.217062 Aug 12 06:52:00.591798 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 249/489] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:00 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:00.947941 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-533cf24f-882c-4de4-8b84-ba34b16fa4d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:00.948919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-533cf24f-882c-4de4-8b84-ba34b16fa4d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:00.959480 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-533cf24f-882c-4de4-8b84-ba34b16fa4d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:00.960426 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-533cf24f-882c-4de4-8b84-ba34b16fa4d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:00.960860 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-533cf24f-882c-4de4-8b84-ba34b16fa4d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:00.961545 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-533cf24f-882c-4de4-8b84-ba34b16fa4d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:00.961992 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-533cf24f-882c-4de4-8b84-ba34b16fa4d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:00.962459 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-533cf24f-882c-4de4-8b84-ba34b16fa4d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:01.105319 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-533cf24f-882c-4de4-8b84-ba34b16fa4d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:01.113425 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-533cf24f-882c-4de4-8b84-ba34b16fa4d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.171900 Aug 12 06:52:01.114185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 241/490] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:00 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:01.584491 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-62629e99-e717-4aeb-906a-d1a64a72d65c tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:01.585097 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-62629e99-e717-4aeb-906a-d1a64a72d65c tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:01.594947 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62629e99-e717-4aeb-906a-d1a64a72d65c tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:01.595656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62629e99-e717-4aeb-906a-d1a64a72d65c tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:01.596280 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62629e99-e717-4aeb-906a-d1a64a72d65c tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:01.597277 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62629e99-e717-4aeb-906a-d1a64a72d65c tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:01.597931 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62629e99-e717-4aeb-906a-d1a64a72d65c tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:01.598550 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62629e99-e717-4aeb-906a-d1a64a72d65c tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:01.612468 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-077ddb17-23b8-4433-b23c-3766efdf2026 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:01.613076 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-077ddb17-23b8-4433-b23c-3766efdf2026 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:01.620151 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-077ddb17-23b8-4433-b23c-3766efdf2026 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:01.620666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-077ddb17-23b8-4433-b23c-3766efdf2026 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:01.621094 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-077ddb17-23b8-4433-b23c-3766efdf2026 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:01.621769 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-077ddb17-23b8-4433-b23c-3766efdf2026 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:01.622211 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-077ddb17-23b8-4433-b23c-3766efdf2026 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:01.622621 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-077ddb17-23b8-4433-b23c-3766efdf2026 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:01.946702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-62629e99-e717-4aeb-906a-d1a64a72d65c tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:01.954661 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-62629e99-e717-4aeb-906a-d1a64a72d65c tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 200 len: 1514 microversion: 2.1 time: 0.376583 Aug 12 06:52:01.955503 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 250/491] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:01 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 1514 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:01.963805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-077ddb17-23b8-4433-b23c-3766efdf2026 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:01.972929 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-077ddb17-23b8-4433-b23c-3766efdf2026 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1729 microversion: 2.1 time: 0.364202 Aug 12 06:52:01.973847 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 242/492] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:01 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1729 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:01.994538 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8889e455-96f0-46ab-9df0-78d1726db7f1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:01.995017 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8889e455-96f0-46ab-9df0-78d1726db7f1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:02.000958 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8889e455-96f0-46ab-9df0-78d1726db7f1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.001442 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8889e455-96f0-46ab-9df0-78d1726db7f1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.001874 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8889e455-96f0-46ab-9df0-78d1726db7f1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.002565 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8889e455-96f0-46ab-9df0-78d1726db7f1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.003042 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8889e455-96f0-46ab-9df0-78d1726db7f1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.003467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8889e455-96f0-46ab-9df0-78d1726db7f1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.082131 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8889e455-96f0-46ab-9df0-78d1726db7f1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091674 Aug 12 06:52:02.085298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 251/493] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 06:52:01 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:02.133810 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-46b4ac49-a7df-46d2-bf50-b2ddad0f7dfe tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:02.134446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-46b4ac49-a7df-46d2-bf50-b2ddad0f7dfe tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:02.140688 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46b4ac49-a7df-46d2-bf50-b2ddad0f7dfe tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.140847 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46b4ac49-a7df-46d2-bf50-b2ddad0f7dfe tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.141139 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46b4ac49-a7df-46d2-bf50-b2ddad0f7dfe tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.141850 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46b4ac49-a7df-46d2-bf50-b2ddad0f7dfe tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.142297 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46b4ac49-a7df-46d2-bf50-b2ddad0f7dfe tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.142708 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-46b4ac49-a7df-46d2-bf50-b2ddad0f7dfe tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.233685 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-654399de-3cf3-4518-8270-8b27afa7744f req-e126558e-655d-450e-8a51-ef1be417c6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf06507b-28e3-41f2-ac29-84475ca09baa", "name": "network-vif-deleted", "tag": "d22bbdd6-71cd-4165-abdf-54e6d2169c7d"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:02.246037 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-654399de-3cf3-4518-8270-8b27afa7744f req-e126558e-655d-450e-8a51-ef1be417c6ab service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.246378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-654399de-3cf3-4518-8270-8b27afa7744f req-e126558e-655d-450e-8a51-ef1be417c6ab service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.246822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-654399de-3cf3-4518-8270-8b27afa7744f req-e126558e-655d-450e-8a51-ef1be417c6ab service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.261973 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-654399de-3cf3-4518-8270-8b27afa7744f req-e126558e-655d-450e-8a51-ef1be417c6ab service nova] Creating event network-vif-deleted:d22bbdd6-71cd-4165-abdf-54e6d2169c7d for instance bf06507b-28e3-41f2-ac29-84475ca09baa on hv-cinder-84457 Aug 12 06:52:02.268826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-654399de-3cf3-4518-8270-8b27afa7744f req-e126558e-655d-450e-8a51-ef1be417c6ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038002 Aug 12 06:52:02.268826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 252/494] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:52:02.507401 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-841fcbe0-e194-41bb-87e1-b15184d6e136 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:02.507996 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-841fcbe0-e194-41bb-87e1-b15184d6e136 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:02.514613 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-841fcbe0-e194-41bb-87e1-b15184d6e136 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.515114 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-841fcbe0-e194-41bb-87e1-b15184d6e136 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.515512 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-841fcbe0-e194-41bb-87e1-b15184d6e136 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.516671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-841fcbe0-e194-41bb-87e1-b15184d6e136 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.516671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-841fcbe0-e194-41bb-87e1-b15184d6e136 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.517024 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-841fcbe0-e194-41bb-87e1-b15184d6e136 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.530193 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-46b4ac49-a7df-46d2-bf50-b2ddad0f7dfe tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:02.537950 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-46b4ac49-a7df-46d2-bf50-b2ddad0f7dfe tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.407926 Aug 12 06:52:02.538853 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 243/495] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:02 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:02.546531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-841fcbe0-e194-41bb-87e1-b15184d6e136 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments/022995e5-d9b0-4b88-91a2-0e18d70ff8b7" status: 200 len: 194 microversion: 2.20 time: 0.043785 Aug 12 06:52:02.551495 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 253/496] 10.222.0.20 () {60 vars in 1454 bytes} [Fri Aug 12 06:52:02 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments/022995e5-d9b0-4b88-91a2-0e18d70ff8b7 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:52:02.620500 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d5c8efd8-eeb7-47a5-8ab8-af0d55cadb8c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:02.621667 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d5c8efd8-eeb7-47a5-8ab8-af0d55cadb8c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:02.629362 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5c8efd8-eeb7-47a5-8ab8-af0d55cadb8c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.630151 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5c8efd8-eeb7-47a5-8ab8-af0d55cadb8c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.631078 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5c8efd8-eeb7-47a5-8ab8-af0d55cadb8c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.632232 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5c8efd8-eeb7-47a5-8ab8-af0d55cadb8c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.633299 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5c8efd8-eeb7-47a5-8ab8-af0d55cadb8c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.633828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5c8efd8-eeb7-47a5-8ab8-af0d55cadb8c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.728400 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-d5c8efd8-eeb7-47a5-8ab8-af0d55cadb8c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lazy-loading 'services' on Instance uuid a6bc12e0-d758-47a7-920d-971a6e993711 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:52:02.817733 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d5c8efd8-eeb7-47a5-8ab8-af0d55cadb8c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments/022995e5-d9b0-4b88-91a2-0e18d70ff8b7" status: 202 len: 0 microversion: 2.20 time: 0.202799 Aug 12 06:52:02.818911 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 244/497] 10.222.0.20 () {60 vars in 1457 bytes} [Fri Aug 12 06:52:02 2022] DELETE /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments/022995e5-d9b0-4b88-91a2-0e18d70ff8b7 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:52:02.828818 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-07b42c38-cb28-4c6a-8cb3-81678a0b63ac tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:02.833099 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-07b42c38-cb28-4c6a-8cb3-81678a0b63ac tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:02.844144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b42c38-cb28-4c6a-8cb3-81678a0b63ac tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.844624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b42c38-cb28-4c6a-8cb3-81678a0b63ac tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.845230 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b42c38-cb28-4c6a-8cb3-81678a0b63ac tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.845924 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b42c38-cb28-4c6a-8cb3-81678a0b63ac tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.846369 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b42c38-cb28-4c6a-8cb3-81678a0b63ac tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.846782 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b42c38-cb28-4c6a-8cb3-81678a0b63ac tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.883828 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-07b42c38-cb28-4c6a-8cb3-81678a0b63ac tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059307 Aug 12 06:52:02.884689 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 254/498] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Aug 12 06:52:02 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 06:52:02.977140 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:02.977965 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: bf06507b-28e3-41f2-ac29-84475ca09baa] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:02.984192 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.984663 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.985085 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.985760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:02.986187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:02.986600 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:02.999860 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] HTTP exception thrown: Instance bf06507b-28e3-41f2-ac29-84475ca09baa could not be found. Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Request method failure captured: Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa HTTP/1.1 Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fhJEK7WzTIPNkLrKg9IfFrBNK30M8xUXqV_AkQmkxsgk3YlAqe4vexE3LlXGBr3YAM5hRvIHtnidwZe7AZAreeVd1ZEQZk9nsdPTjq120rZUOfsSkqM00TGCTKnevu9jIJ0KNf77Jgxlnf4EWumrqLsLBVHmcwhc2rkUbUB-dxH-xA Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 7de24610a31e4f65908ac9f4ca56cbae Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1936047152 Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:52:03.001507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7de24610a31e4f65908ac9f4ca56cbae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7de24610a31e4f65908ac9f4ca56cbae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7de24610a31e4f65908ac9f4ca56cbae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7de24610a31e4f65908ac9f4ca56cbae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesSnapshotTestJSON-1936047152 Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 7de24610a31e4f65908ac9f4ca56cbae Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1936047152 Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesSnapshotTestJSON-1936047152-project Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: c84dd7d7aec747b482cadf308411ea61 Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesSnapshotTestJSON-1936047152-project Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance bf06507b-28e3-41f2-ac29-84475ca09baa could not be found. Aug 12 06:52:03.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': 'bf06507b-28e3-41f2-ac29-84475ca09baa'} Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf06507b-28e3-41f2-ac29-84475ca09baa could not be found. Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:52:03.003728 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf06507b-28e3-41f2-ac29-84475ca09baa could not be found. Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf06507b-28e3-41f2-ac29-84475ca09baa could not be found. Aug 12 06:52:03.005246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:03.006329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Returning 404 to user: Instance bf06507b-28e3-41f2-ac29-84475ca09baa could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:52:03.006329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9f25a85b-ecf5-4aad-932f-d6a3c5755dea tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa" status: 404 len: 111 microversion: 2.1 time: 0.030405 Aug 12 06:52:03.006329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 245/499] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:02 2022] GET /compute/v2.1/servers/bf06507b-28e3-41f2-ac29-84475ca09baa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:52:03.559516 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-690f7aaa-f42b-489e-ad73-5f8515646a97 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:03.560043 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-690f7aaa-f42b-489e-ad73-5f8515646a97 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:03.566460 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-690f7aaa-f42b-489e-ad73-5f8515646a97 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:03.566997 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-690f7aaa-f42b-489e-ad73-5f8515646a97 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:03.567480 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-690f7aaa-f42b-489e-ad73-5f8515646a97 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:03.568173 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-690f7aaa-f42b-489e-ad73-5f8515646a97 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:03.568624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-690f7aaa-f42b-489e-ad73-5f8515646a97 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:03.569030 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-690f7aaa-f42b-489e-ad73-5f8515646a97 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:03.734190 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7344db9a-42e0-4bce-86b5-e269321e3baa tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:03.740894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7344db9a-42e0-4bce-86b5-e269321e3baa tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:03.741435 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7344db9a-42e0-4bce-86b5-e269321e3baa tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:03.741929 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7344db9a-42e0-4bce-86b5-e269321e3baa tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:03.764498 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7344db9a-42e0-4bce-86b5-e269321e3baa tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Going to try to stop instance {{(pid=127087) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 12 06:52:03.785573 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-690f7aaa-f42b-489e-ad73-5f8515646a97 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:03.795897 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-690f7aaa-f42b-489e-ad73-5f8515646a97 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.239799 Aug 12 06:52:03.796540 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 255/500] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:03 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:03.816846 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7344db9a-42e0-4bce-86b5-e269321e3baa tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "POST /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/action" status: 202 len: 0 microversion: 2.1 time: 0.086386 Aug 12 06:52:03.817447 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 246/501] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:52:03 2022] POST /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:52:03.830593 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4a3211df-45b8-4162-8654-a9e78e6696df tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:03.831533 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4a3211df-45b8-4162-8654-a9e78e6696df tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:03.837792 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a3211df-45b8-4162-8654-a9e78e6696df tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:03.838626 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a3211df-45b8-4162-8654-a9e78e6696df tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:03.838993 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-c8396867-fb2e-4708-9066-bef2a0ac5b7e req-a7b2489d-1d6e-4b3f-b202-e1716942140c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1d2c7f-0786-4d54-8a52-d1d3deac1f29", "tag": "09e645cd-262e-494b-8463-19e7e2065876"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:03.839440 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a3211df-45b8-4162-8654-a9e78e6696df tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:03.840278 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a3211df-45b8-4162-8654-a9e78e6696df tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:03.840917 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a3211df-45b8-4162-8654-a9e78e6696df tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:03.841618 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a3211df-45b8-4162-8654-a9e78e6696df tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:03.854721 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-c8396867-fb2e-4708-9066-bef2a0ac5b7e req-a7b2489d-1d6e-4b3f-b202-e1716942140c service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:03.856093 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-c8396867-fb2e-4708-9066-bef2a0ac5b7e req-a7b2489d-1d6e-4b3f-b202-e1716942140c service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:03.856526 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-c8396867-fb2e-4708-9066-bef2a0ac5b7e req-a7b2489d-1d6e-4b3f-b202-e1716942140c service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:03.872391 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-c8396867-fb2e-4708-9066-bef2a0ac5b7e req-a7b2489d-1d6e-4b3f-b202-e1716942140c service nova] Creating event network-changed:09e645cd-262e-494b-8463-19e7e2065876 for instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 on hv-cinder-84457 Aug 12 06:52:03.877435 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-c8396867-fb2e-4708-9066-bef2a0ac5b7e req-a7b2489d-1d6e-4b3f-b202-e1716942140c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044625 Aug 12 06:52:03.878047 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 247/502] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:52:03.898094 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7bacfbbc-2e00-473f-b9c4-5881159f8077 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:03.900750 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7bacfbbc-2e00-473f-b9c4-5881159f8077 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:03.907057 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bacfbbc-2e00-473f-b9c4-5881159f8077 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:03.907640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bacfbbc-2e00-473f-b9c4-5881159f8077 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:03.908161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bacfbbc-2e00-473f-b9c4-5881159f8077 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:03.908938 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bacfbbc-2e00-473f-b9c4-5881159f8077 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:03.909500 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bacfbbc-2e00-473f-b9c4-5881159f8077 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:03.910731 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bacfbbc-2e00-473f-b9c4-5881159f8077 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:03.942379 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7bacfbbc-2e00-473f-b9c4-5881159f8077 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048985 Aug 12 06:52:03.942991 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 248/503] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Aug 12 06:52:03 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 06:52:03.983373 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4a3211df-45b8-4162-8654-a9e78e6696df tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:03.991087 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4a3211df-45b8-4162-8654-a9e78e6696df tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.165823 Aug 12 06:52:03.991741 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 256/504] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:03 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:04.817303 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e2749959-af6f-46be-9cf3-cc66e74df5a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:04.817917 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e2749959-af6f-46be-9cf3-cc66e74df5a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:04.824866 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2749959-af6f-46be-9cf3-cc66e74df5a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:04.825360 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2749959-af6f-46be-9cf3-cc66e74df5a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:04.825781 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2749959-af6f-46be-9cf3-cc66e74df5a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:04.826567 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2749959-af6f-46be-9cf3-cc66e74df5a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:04.826952 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2749959-af6f-46be-9cf3-cc66e74df5a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:04.827417 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2749959-af6f-46be-9cf3-cc66e74df5a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:04.954904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-37544ff2-689c-4a7b-ba81-f377c34c8053 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:04.957265 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-37544ff2-689c-4a7b-ba81-f377c34c8053 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:04.961281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e2749959-af6f-46be-9cf3-cc66e74df5a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:04.964538 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37544ff2-689c-4a7b-ba81-f377c34c8053 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:04.965229 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37544ff2-689c-4a7b-ba81-f377c34c8053 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:04.965654 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37544ff2-689c-4a7b-ba81-f377c34c8053 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:04.966339 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37544ff2-689c-4a7b-ba81-f377c34c8053 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:04.966787 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37544ff2-689c-4a7b-ba81-f377c34c8053 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:04.967237 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37544ff2-689c-4a7b-ba81-f377c34c8053 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:04.969351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e2749959-af6f-46be-9cf3-cc66e74df5a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.155882 Aug 12 06:52:04.970023 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 249/505] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:04 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:04.996870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-37544ff2-689c-4a7b-ba81-f377c34c8053 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045968 Aug 12 06:52:04.997456 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 257/506] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Aug 12 06:52:04 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 06:52:05.011976 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-67f932ef-c600-44b8-a1fe-455c98849564 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:05.012573 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-67f932ef-c600-44b8-a1fe-455c98849564 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:05.018514 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67f932ef-c600-44b8-a1fe-455c98849564 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:05.019003 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67f932ef-c600-44b8-a1fe-455c98849564 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:05.019444 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67f932ef-c600-44b8-a1fe-455c98849564 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:05.020418 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67f932ef-c600-44b8-a1fe-455c98849564 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:05.020888 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67f932ef-c600-44b8-a1fe-455c98849564 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:05.021301 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67f932ef-c600-44b8-a1fe-455c98849564 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:05.025524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:05.090111 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:05.113246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=10 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:05.160391 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-67f932ef-c600-44b8-a1fe-455c98849564 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:05.168380 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-67f932ef-c600-44b8-a1fe-455c98849564 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.160167 Aug 12 06:52:05.168945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 250/507] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:05 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:05.897298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-cc2a98a0-34c9-4522-96b8-e84fb9aeae38 req-bcdc3ff9-79ef-4009-9894-94bb9fc1796e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1d2c7f-0786-4d54-8a52-d1d3deac1f29", "tag": "09e645cd-262e-494b-8463-19e7e2065876"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:05.904659 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:05.913213 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cc2a98a0-34c9-4522-96b8-e84fb9aeae38 req-bcdc3ff9-79ef-4009-9894-94bb9fc1796e service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:05.913858 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cc2a98a0-34c9-4522-96b8-e84fb9aeae38 req-bcdc3ff9-79ef-4009-9894-94bb9fc1796e service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:05.914279 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cc2a98a0-34c9-4522-96b8-e84fb9aeae38 req-bcdc3ff9-79ef-4009-9894-94bb9fc1796e service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:05.926681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-cc2a98a0-34c9-4522-96b8-e84fb9aeae38 req-bcdc3ff9-79ef-4009-9894-94bb9fc1796e service nova] Creating event network-changed:09e645cd-262e-494b-8463-19e7e2065876 for instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 on hv-cinder-84457 Aug 12 06:52:05.931617 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-cc2a98a0-34c9-4522-96b8-e84fb9aeae38 req-bcdc3ff9-79ef-4009-9894-94bb9fc1796e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040533 Aug 12 06:52:05.932182 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 258/508] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:05.989901 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cae97850-79bd-4db7-a07b-254289d2b491 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:05.990498 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cae97850-79bd-4db7-a07b-254289d2b491 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:05.998169 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cae97850-79bd-4db7-a07b-254289d2b491 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:05.998666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cae97850-79bd-4db7-a07b-254289d2b491 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:05.999169 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cae97850-79bd-4db7-a07b-254289d2b491 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:05.999777 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cae97850-79bd-4db7-a07b-254289d2b491 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:06.000214 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cae97850-79bd-4db7-a07b-254289d2b491 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:06.000637 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cae97850-79bd-4db7-a07b-254289d2b491 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:06.011569 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-330e70e9-1560-45f4-9850-b96d4e6a9af2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:06.013899 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-330e70e9-1560-45f4-9850-b96d4e6a9af2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:06.020669 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-330e70e9-1560-45f4-9850-b96d4e6a9af2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:06.021264 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-330e70e9-1560-45f4-9850-b96d4e6a9af2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:06.021897 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-330e70e9-1560-45f4-9850-b96d4e6a9af2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:06.022659 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-330e70e9-1560-45f4-9850-b96d4e6a9af2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:06.023232 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-330e70e9-1560-45f4-9850-b96d4e6a9af2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:06.023709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-330e70e9-1560-45f4-9850-b96d4e6a9af2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:06.053123 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-330e70e9-1560-45f4-9850-b96d4e6a9af2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047186 Aug 12 06:52:06.053811 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 259/509] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Aug 12 06:52:06 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:52:06.189006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4d64639-b727-4bb8-a91b-2117a47f65d4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:06.189520 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4d64639-b727-4bb8-a91b-2117a47f65d4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:06.195519 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d64639-b727-4bb8-a91b-2117a47f65d4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:06.196006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d64639-b727-4bb8-a91b-2117a47f65d4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:06.196436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d64639-b727-4bb8-a91b-2117a47f65d4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:06.197945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d64639-b727-4bb8-a91b-2117a47f65d4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:06.198513 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d64639-b727-4bb8-a91b-2117a47f65d4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:06.199233 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d64639-b727-4bb8-a91b-2117a47f65d4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:06.232430 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cae97850-79bd-4db7-a07b-254289d2b491 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:06.240531 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cae97850-79bd-4db7-a07b-254289d2b491 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.254431 Aug 12 06:52:06.241128 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 251/510] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:05 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:06.398135 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f4d64639-b727-4bb8-a91b-2117a47f65d4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:06.406201 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f4d64639-b727-4bb8-a91b-2117a47f65d4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.221146 Aug 12 06:52:06.419439 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 260/511] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:06 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:07.069923 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3c50187e-a19f-438a-a156-91bb216bbffb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:07.073382 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3c50187e-a19f-438a-a156-91bb216bbffb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:07.084164 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c50187e-a19f-438a-a156-91bb216bbffb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:07.084959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c50187e-a19f-438a-a156-91bb216bbffb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:07.085777 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c50187e-a19f-438a-a156-91bb216bbffb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:07.086473 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c50187e-a19f-438a-a156-91bb216bbffb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:07.086917 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c50187e-a19f-438a-a156-91bb216bbffb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:07.087364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c50187e-a19f-438a-a156-91bb216bbffb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:07.116205 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3c50187e-a19f-438a-a156-91bb216bbffb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053160 Aug 12 06:52:07.116824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 252/512] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Aug 12 06:52:07 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:52:07.262457 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-20721f9e-d81f-418d-9867-dae03db9653d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:07.263082 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-20721f9e-d81f-418d-9867-dae03db9653d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:07.269696 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-20721f9e-d81f-418d-9867-dae03db9653d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:07.270465 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-20721f9e-d81f-418d-9867-dae03db9653d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:07.271083 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-20721f9e-d81f-418d-9867-dae03db9653d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:07.271791 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-20721f9e-d81f-418d-9867-dae03db9653d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:07.272250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-20721f9e-d81f-418d-9867-dae03db9653d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:07.272794 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-20721f9e-d81f-418d-9867-dae03db9653d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:07.427248 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d38f75f9-6bbf-4534-805a-5ccedbd75cbc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:07.427846 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d38f75f9-6bbf-4534-805a-5ccedbd75cbc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:07.433874 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d38f75f9-6bbf-4534-805a-5ccedbd75cbc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:07.434358 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d38f75f9-6bbf-4534-805a-5ccedbd75cbc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:07.434786 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d38f75f9-6bbf-4534-805a-5ccedbd75cbc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:07.435498 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d38f75f9-6bbf-4534-805a-5ccedbd75cbc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:07.435955 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d38f75f9-6bbf-4534-805a-5ccedbd75cbc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:07.436398 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d38f75f9-6bbf-4534-805a-5ccedbd75cbc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:07.464377 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-20721f9e-d81f-418d-9867-dae03db9653d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:07.473891 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-20721f9e-d81f-418d-9867-dae03db9653d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.215760 Aug 12 06:52:07.474470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 261/513] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:07 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:07.680258 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d38f75f9-6bbf-4534-805a-5ccedbd75cbc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:07.692402 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d38f75f9-6bbf-4534-805a-5ccedbd75cbc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.268172 Aug 12 06:52:07.692997 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 253/514] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:07 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:52:08.132896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-265be82f-0034-4580-b5f6-3f556bbcc3b9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:08.135250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-265be82f-0034-4580-b5f6-3f556bbcc3b9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:08.141730 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265be82f-0034-4580-b5f6-3f556bbcc3b9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:08.142238 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265be82f-0034-4580-b5f6-3f556bbcc3b9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:08.142673 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265be82f-0034-4580-b5f6-3f556bbcc3b9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:08.143404 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265be82f-0034-4580-b5f6-3f556bbcc3b9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:08.143852 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265be82f-0034-4580-b5f6-3f556bbcc3b9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:08.144269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-265be82f-0034-4580-b5f6-3f556bbcc3b9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:08.173244 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-265be82f-0034-4580-b5f6-3f556bbcc3b9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047043 Aug 12 06:52:08.173808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 262/515] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Aug 12 06:52:08 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:08.242599 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2e8676a1-6994-4141-9a36-0a83d82b5dd9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:08.243153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2e8676a1-6994-4141-9a36-0a83d82b5dd9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:08.252797 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8676a1-6994-4141-9a36-0a83d82b5dd9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:08.253304 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8676a1-6994-4141-9a36-0a83d82b5dd9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:08.253867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8676a1-6994-4141-9a36-0a83d82b5dd9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:08.255186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8676a1-6994-4141-9a36-0a83d82b5dd9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:08.255683 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8676a1-6994-4141-9a36-0a83d82b5dd9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:08.256165 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8676a1-6994-4141-9a36-0a83d82b5dd9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:08.282432 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2e8676a1-6994-4141-9a36-0a83d82b5dd9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:52:08.368736 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2e8676a1-6994-4141-9a36-0a83d82b5dd9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 204 len: 0 microversion: 2.20 time: 0.132007 Aug 12 06:52:08.369358 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 254/516] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Aug 12 06:52:08 2022] DELETE /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 06:52:08.379283 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:08.379885 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:08.386746 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:08.387260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:08.387687 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:08.388378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:08.388835 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:08.389244 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:08.497730 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-77da84ab-741a-4428-81b5-29cf3cb49536 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:08.498439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-77da84ab-741a-4428-81b5-29cf3cb49536 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:08.504623 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77da84ab-741a-4428-81b5-29cf3cb49536 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:08.505084 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77da84ab-741a-4428-81b5-29cf3cb49536 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:08.505706 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77da84ab-741a-4428-81b5-29cf3cb49536 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:08.506934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77da84ab-741a-4428-81b5-29cf3cb49536 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:08.507593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77da84ab-741a-4428-81b5-29cf3cb49536 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:08.508013 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77da84ab-741a-4428-81b5-29cf3cb49536 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:08.534797 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:08.537266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:08.545464 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:08.546958 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:08.548166 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-88d1c238-fe4e-4ddd-963e-49bb1354fccf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.172895 Aug 12 06:52:08.548724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 263/517] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:08 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:52:08.646419 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-77da84ab-741a-4428-81b5-29cf3cb49536 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:08.655177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-77da84ab-741a-4428-81b5-29cf3cb49536 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.162298 Aug 12 06:52:08.655751 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 255/518] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:08 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:08.713572 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fefd3f19-0548-4924-b93e-ec1bf904679d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:08.714177 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fefd3f19-0548-4924-b93e-ec1bf904679d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:08.720613 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fefd3f19-0548-4924-b93e-ec1bf904679d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:08.720999 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fefd3f19-0548-4924-b93e-ec1bf904679d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:08.721439 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fefd3f19-0548-4924-b93e-ec1bf904679d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:08.722131 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fefd3f19-0548-4924-b93e-ec1bf904679d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:08.722586 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fefd3f19-0548-4924-b93e-ec1bf904679d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:08.723005 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fefd3f19-0548-4924-b93e-ec1bf904679d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:08.890755 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fefd3f19-0548-4924-b93e-ec1bf904679d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:08.899388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fefd3f19-0548-4924-b93e-ec1bf904679d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.190003 Aug 12 06:52:08.899959 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 264/519] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:08 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:09.572184 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:09.572920 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:09.581184 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:09.581778 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:09.582306 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:09.583193 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:09.583746 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:09.584262 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:09.675508 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d62d1c5b-7529-4853-b09f-ebbc8a478bc3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:09.676331 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d62d1c5b-7529-4853-b09f-ebbc8a478bc3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:09.682820 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d62d1c5b-7529-4853-b09f-ebbc8a478bc3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:09.683398 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d62d1c5b-7529-4853-b09f-ebbc8a478bc3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:09.683854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d62d1c5b-7529-4853-b09f-ebbc8a478bc3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:09.684496 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d62d1c5b-7529-4853-b09f-ebbc8a478bc3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:09.684935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d62d1c5b-7529-4853-b09f-ebbc8a478bc3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:09.685346 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d62d1c5b-7529-4853-b09f-ebbc8a478bc3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:09.717328 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:09.725447 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:09.727081 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:09.728243 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4eb8cb1d-eb31-4857-9243-2168b88ab292 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.161105 Aug 12 06:52:09.728807 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 256/520] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:09 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:09.814588 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d62d1c5b-7529-4853-b09f-ebbc8a478bc3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:09.822194 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d62d1c5b-7529-4853-b09f-ebbc8a478bc3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.150440 Aug 12 06:52:09.822763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 265/521] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:09 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:52:09.921321 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-18202d9f-add9-4003-9079-61389892e499 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:09.922018 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-18202d9f-add9-4003-9079-61389892e499 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:09.929282 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18202d9f-add9-4003-9079-61389892e499 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:09.929844 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18202d9f-add9-4003-9079-61389892e499 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:09.930396 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18202d9f-add9-4003-9079-61389892e499 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:09.931119 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18202d9f-add9-4003-9079-61389892e499 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:09.931568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18202d9f-add9-4003-9079-61389892e499 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:09.931985 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18202d9f-add9-4003-9079-61389892e499 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:10.067224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-18202d9f-add9-4003-9079-61389892e499 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:10.074882 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-18202d9f-add9-4003-9079-61389892e499 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.158095 Aug 12 06:52:10.075484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 257/522] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:09 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:10.755511 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:10.756608 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:10.767484 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:10.768817 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:10.768991 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:10.770497 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:10.771304 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:10.772011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:10.841022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-590079831", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "networks": [{"uuid": "047a5092-c563-46a3-97a5-2942955cfb18"}]}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:10.896112 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] validate_networks() for [('047a5092-c563-46a3-97a5-2942955cfb18', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:52:10.903478 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:10.914558 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:10.916258 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:10.917514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d8f13974-b5f6-47f7-ae00-001e82f88999 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.168578 Aug 12 06:52:10.918170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 266/523] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:10 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:10.922791 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-53acabc0-bdcd-40b9-ab19-d0e0833be7ba tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:10.923415 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-53acabc0-bdcd-40b9-ab19-d0e0833be7ba tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:10.929526 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53acabc0-bdcd-40b9-ab19-d0e0833be7ba tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:10.930068 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53acabc0-bdcd-40b9-ab19-d0e0833be7ba tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:10.930528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53acabc0-bdcd-40b9-ab19-d0e0833be7ba tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:10.931239 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53acabc0-bdcd-40b9-ab19-d0e0833be7ba tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:10.931689 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53acabc0-bdcd-40b9-ab19-d0e0833be7ba tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:10.932111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53acabc0-bdcd-40b9-ab19-d0e0833be7ba tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:11.127779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-53acabc0-bdcd-40b9-ab19-d0e0833be7ba tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:11.135487 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-53acabc0-bdcd-40b9-ab19-d0e0833be7ba tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.216134 Aug 12 06:52:11.136624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 267/524] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:10 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:11.141293 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-09f65d83-e0bf-4188-9002-1f5be6dcf672 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:11.141889 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-09f65d83-e0bf-4188-9002-1f5be6dcf672 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:11.148116 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09f65d83-e0bf-4188-9002-1f5be6dcf672 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:11.149177 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09f65d83-e0bf-4188-9002-1f5be6dcf672 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:11.150171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09f65d83-e0bf-4188-9002-1f5be6dcf672 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:11.151423 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09f65d83-e0bf-4188-9002-1f5be6dcf672 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:11.152212 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09f65d83-e0bf-4188-9002-1f5be6dcf672 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:11.152937 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09f65d83-e0bf-4188-9002-1f5be6dcf672 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:11.362145 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-09f65d83-e0bf-4188-9002-1f5be6dcf672 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:11.370066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-09f65d83-e0bf-4188-9002-1f5be6dcf672 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.232204 Aug 12 06:52:11.370608 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 268/525] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:11 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:11.376991 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:52:11.377438 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:52:11.377897 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:52:11.378311 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:52:11.378709 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:52:11.388000 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:11.388469 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:11.388892 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:11.389604 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:11.390054 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:11.390472 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:11.407182 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Getting quotas for project 7de24610a31e4f65908ac9f4ca56cbae. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:52:11.411109 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Getting quotas for user c84dd7d7aec747b482cadf308411ea61 and project 7de24610a31e4f65908ac9f4ca56cbae. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:52:11.413358 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:11.423849 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:52:11.426048 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:52:11.475229 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-612151d1-0b52-4269-9416-c1aae59dec55 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638094 Aug 12 06:52:11.475871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 258/526] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:52:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:52:11.486846 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-58d04a56-e520-4afc-9e5a-6f89451cd1f8 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:11.487472 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-58d04a56-e520-4afc-9e5a-6f89451cd1f8 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:11.543071 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-58d04a56-e520-4afc-9e5a-6f89451cd1f8 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:11.549835 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-58d04a56-e520-4afc-9e5a-6f89451cd1f8 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1218 microversion: 2.1 time: 0.066957 Aug 12 06:52:11.550400 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 269/527] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:11 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:11.943434 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:11.943980 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:11.951416 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:11.951970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:11.952515 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:11.953345 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:11.953790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:11.954199 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:12.156464 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3a1f330e-8718-4571-a4b1-ebbbaffca9e4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:12.157158 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3a1f330e-8718-4571-a4b1-ebbbaffca9e4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:12.168378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a1f330e-8718-4571-a4b1-ebbbaffca9e4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:12.168866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a1f330e-8718-4571-a4b1-ebbbaffca9e4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:12.169280 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a1f330e-8718-4571-a4b1-ebbbaffca9e4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:12.170252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a1f330e-8718-4571-a4b1-ebbbaffca9e4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:12.170702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a1f330e-8718-4571-a4b1-ebbbaffca9e4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:12.171144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a1f330e-8718-4571-a4b1-ebbbaffca9e4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:12.510024 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:12.519519 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:12.521520 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:12.522924 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fc67229d-3ea1-4aa1-8945-0b36f796a8a4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1724 microversion: 2.20 time: 0.584151 Aug 12 06:52:12.523523 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 259/528] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:11 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1724 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:12.535112 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3a1f330e-8718-4571-a4b1-ebbbaffca9e4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:12.535437 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-24716aa3-685a-47a7-ab60-52c81a845ecf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:12.535437 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-24716aa3-685a-47a7-ab60-52c81a845ecf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:12.535437 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24716aa3-685a-47a7-ab60-52c81a845ecf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:12.535437 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24716aa3-685a-47a7-ab60-52c81a845ecf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:12.535788 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3a1f330e-8718-4571-a4b1-ebbbaffca9e4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.383318 Aug 12 06:52:12.535886 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24716aa3-685a-47a7-ab60-52c81a845ecf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:12.539591 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24716aa3-685a-47a7-ab60-52c81a845ecf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:12.539591 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24716aa3-685a-47a7-ab60-52c81a845ecf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:12.539591 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24716aa3-685a-47a7-ab60-52c81a845ecf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:12.542304 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 270/529] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:12 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:52:12.569571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-50f320a7-693a-4da3-b89f-a7e6e6a3d064 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:12.570204 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-50f320a7-693a-4da3-b89f-a7e6e6a3d064 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:12.577347 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50f320a7-693a-4da3-b89f-a7e6e6a3d064 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:12.577828 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50f320a7-693a-4da3-b89f-a7e6e6a3d064 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:12.578252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50f320a7-693a-4da3-b89f-a7e6e6a3d064 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:12.578942 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50f320a7-693a-4da3-b89f-a7e6e6a3d064 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:12.579427 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50f320a7-693a-4da3-b89f-a7e6e6a3d064 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:12.579843 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50f320a7-693a-4da3-b89f-a7e6e6a3d064 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:12.657573 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-50f320a7-693a-4da3-b89f-a7e6e6a3d064 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:12.665539 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-50f320a7-693a-4da3-b89f-a7e6e6a3d064 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1270 microversion: 2.1 time: 0.099733 Aug 12 06:52:12.666367 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 271/530] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:12 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:12.687757 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-24716aa3-685a-47a7-ab60-52c81a845ecf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:12.695751 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-24716aa3-685a-47a7-ab60-52c81a845ecf tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.171077 Aug 12 06:52:12.696316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 260/531] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:12 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:13.142587 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-86d591e8-be4e-415b-a616-8d2b42b2981b req-da5969fa-3eba-4037-967e-8876955301fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337150f7-22b7-4d35-9da2-df74b549b5b2", "name": "network-vif-plugged", "status": "completed", "tag": "0692b8e8-530a-4198-b110-0f594f201062"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:13.155202 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-86d591e8-be4e-415b-a616-8d2b42b2981b req-da5969fa-3eba-4037-967e-8876955301fe service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:13.156003 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-86d591e8-be4e-415b-a616-8d2b42b2981b req-da5969fa-3eba-4037-967e-8876955301fe service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:13.156681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-86d591e8-be4e-415b-a616-8d2b42b2981b req-da5969fa-3eba-4037-967e-8876955301fe service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:13.172942 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-86d591e8-be4e-415b-a616-8d2b42b2981b req-da5969fa-3eba-4037-967e-8876955301fe service nova] Creating event network-vif-plugged:0692b8e8-530a-4198-b110-0f594f201062 for instance 337150f7-22b7-4d35-9da2-df74b549b5b2 on hv-cinder-84457 Aug 12 06:52:13.180155 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-86d591e8-be4e-415b-a616-8d2b42b2981b req-da5969fa-3eba-4037-967e-8876955301fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040839 Aug 12 06:52:13.181463 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 272/532] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:13.548072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:13.548667 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:13.555510 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:13.556182 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:13.556759 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:13.557214 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5b138b05-7cf6-45f6-a61b-160c4c0790a0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:13.557787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:13.557907 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5b138b05-7cf6-45f6-a61b-160c4c0790a0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:13.558480 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:13.559098 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:13.572170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b138b05-7cf6-45f6-a61b-160c4c0790a0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:13.572921 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b138b05-7cf6-45f6-a61b-160c4c0790a0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:13.574005 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b138b05-7cf6-45f6-a61b-160c4c0790a0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:13.574884 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b138b05-7cf6-45f6-a61b-160c4c0790a0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:13.575684 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b138b05-7cf6-45f6-a61b-160c4c0790a0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:13.576338 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b138b05-7cf6-45f6-a61b-160c4c0790a0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:13.683382 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:13.700493 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:13.702063 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:13.703281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fa92f460-9834-4fcc-89de-fca6fc43f6eb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1657 microversion: 2.20 time: 0.159754 Aug 12 06:52:13.704342 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 261/533] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:13 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:13.710478 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-97fe07e3-18aa-4433-a4fd-599e50a169e4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:13.711423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-97fe07e3-18aa-4433-a4fd-599e50a169e4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:13.731335 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fe07e3-18aa-4433-a4fd-599e50a169e4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:13.746055 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fe07e3-18aa-4433-a4fd-599e50a169e4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:13.747749 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fe07e3-18aa-4433-a4fd-599e50a169e4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:13.748656 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fe07e3-18aa-4433-a4fd-599e50a169e4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:13.750549 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fe07e3-18aa-4433-a4fd-599e50a169e4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:13.751968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fe07e3-18aa-4433-a4fd-599e50a169e4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:13.884275 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5b138b05-7cf6-45f6-a61b-160c4c0790a0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:13.898318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5b138b05-7cf6-45f6-a61b-160c4c0790a0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1367 microversion: 2.1 time: 0.345188 Aug 12 06:52:13.899514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 273/534] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:13 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:13.905248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-82a173dd-b19c-43c0-b91a-ab6d1eedfd3d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:13.906123 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-82a173dd-b19c-43c0-b91a-ab6d1eedfd3d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:13.915747 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a173dd-b19c-43c0-b91a-ab6d1eedfd3d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:13.916309 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a173dd-b19c-43c0-b91a-ab6d1eedfd3d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:13.916828 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a173dd-b19c-43c0-b91a-ab6d1eedfd3d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:13.917597 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a173dd-b19c-43c0-b91a-ab6d1eedfd3d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:13.918360 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a173dd-b19c-43c0-b91a-ab6d1eedfd3d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:13.918970 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a173dd-b19c-43c0-b91a-ab6d1eedfd3d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:13.960288 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-97fe07e3-18aa-4433-a4fd-599e50a169e4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:13.967765 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-97fe07e3-18aa-4433-a4fd-599e50a169e4 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1318 microversion: 2.1 time: 0.262233 Aug 12 06:52:13.968340 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 262/535] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:13 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:13.973215 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-ffb76665-0655-4318-bfd6-8fba188f9bce req-33303a7a-ba10-4b90-b658-e8f08d882c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6bc12e0-d758-47a7-920d-971a6e993711", "name": "network-vif-deleted", "tag": "2de31bfc-bbcb-4a81-989c-adfbe72a2aac"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:13.982880 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ffb76665-0655-4318-bfd6-8fba188f9bce req-33303a7a-ba10-4b90-b658-e8f08d882c58 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:13.983817 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ffb76665-0655-4318-bfd6-8fba188f9bce req-33303a7a-ba10-4b90-b658-e8f08d882c58 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:13.984517 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ffb76665-0655-4318-bfd6-8fba188f9bce req-33303a7a-ba10-4b90-b658-e8f08d882c58 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:13.997900 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-ffb76665-0655-4318-bfd6-8fba188f9bce req-33303a7a-ba10-4b90-b658-e8f08d882c58 service nova] Creating event network-vif-deleted:2de31bfc-bbcb-4a81-989c-adfbe72a2aac for instance a6bc12e0-d758-47a7-920d-971a6e993711 on hv-cinder-84457 Aug 12 06:52:14.003517 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-ffb76665-0655-4318-bfd6-8fba188f9bce req-33303a7a-ba10-4b90-b658-e8f08d882c58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033736 Aug 12 06:52:14.004725 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 263/536] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:14.084087 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-82a173dd-b19c-43c0-b91a-ab6d1eedfd3d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:14.093037 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-82a173dd-b19c-43c0-b91a-ab6d1eedfd3d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.191461 Aug 12 06:52:14.093803 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 274/537] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:13 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:14.220895 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-9dc9060e-411a-4339-9082-13a9b3e8aae5 req-86d92964-9745-4705-a4ba-dfdb497ff30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7670ae99-2d30-43e4-96ee-381e4325ac3e", "tag": "743534c4-f606-4de9-b908-d3d903041395"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:14.233338 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-9dc9060e-411a-4339-9082-13a9b3e8aae5 req-86d92964-9745-4705-a4ba-dfdb497ff30d service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:14.233820 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-9dc9060e-411a-4339-9082-13a9b3e8aae5 req-86d92964-9745-4705-a4ba-dfdb497ff30d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:14.234946 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-9dc9060e-411a-4339-9082-13a9b3e8aae5 req-86d92964-9745-4705-a4ba-dfdb497ff30d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:14.248406 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-9dc9060e-411a-4339-9082-13a9b3e8aae5 req-86d92964-9745-4705-a4ba-dfdb497ff30d service nova] Creating event network-changed:743534c4-f606-4de9-b908-d3d903041395 for instance 7670ae99-2d30-43e4-96ee-381e4325ac3e on hv-cinder-84457 Aug 12 06:52:14.254719 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-9dc9060e-411a-4339-9082-13a9b3e8aae5 req-86d92964-9745-4705-a4ba-dfdb497ff30d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037571 Aug 12 06:52:14.256187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 264/538] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:14.728473 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:14.729055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:14.735984 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:14.736582 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:14.737081 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:14.737849 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:14.738364 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:14.738852 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:14.776398 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:14.776878 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:14.777303 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:14.777749 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lazy-loading 'fault' on Instance uuid a6bc12e0-d758-47a7-920d-971a6e993711 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:52:14.822569 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:14.830801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:14.832351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:14.833515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a723790d-49d3-4c65-a05a-7d81f04676f3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 200 len: 1372 microversion: 2.20 time: 0.109108 Aug 12 06:52:14.834118 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 275/539] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:14 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:14.920617 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5284b8be-51a1-4a04-9b6e-63476fedfd35 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:14.921320 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5284b8be-51a1-4a04-9b6e-63476fedfd35 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:14.932716 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5284b8be-51a1-4a04-9b6e-63476fedfd35 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:14.941224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5284b8be-51a1-4a04-9b6e-63476fedfd35 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:14.942567 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5284b8be-51a1-4a04-9b6e-63476fedfd35 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:14.943960 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5284b8be-51a1-4a04-9b6e-63476fedfd35 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:14.944726 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5284b8be-51a1-4a04-9b6e-63476fedfd35 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:14.945347 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5284b8be-51a1-4a04-9b6e-63476fedfd35 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:14.988556 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5fb022de-1054-4428-a7cf-3eb22bf6d72f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:14.989335 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5fb022de-1054-4428-a7cf-3eb22bf6d72f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:14.998366 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5fb022de-1054-4428-a7cf-3eb22bf6d72f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:14.998864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5fb022de-1054-4428-a7cf-3eb22bf6d72f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:15.003324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5fb022de-1054-4428-a7cf-3eb22bf6d72f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:15.004335 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5fb022de-1054-4428-a7cf-3eb22bf6d72f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:15.004997 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5fb022de-1054-4428-a7cf-3eb22bf6d72f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:15.005515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5fb022de-1054-4428-a7cf-3eb22bf6d72f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:15.130666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5284b8be-51a1-4a04-9b6e-63476fedfd35 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:15.138918 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5284b8be-51a1-4a04-9b6e-63476fedfd35 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1557 microversion: 2.1 time: 0.222661 Aug 12 06:52:15.139564 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 265/540] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:14 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:15.144208 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-701a097c-92ea-469a-b9fb-2cde48a8555c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:15.145250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-701a097c-92ea-469a-b9fb-2cde48a8555c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:15.151769 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-701a097c-92ea-469a-b9fb-2cde48a8555c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:15.152256 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-701a097c-92ea-469a-b9fb-2cde48a8555c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:15.152678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-701a097c-92ea-469a-b9fb-2cde48a8555c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:15.153401 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-701a097c-92ea-469a-b9fb-2cde48a8555c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:15.153837 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-701a097c-92ea-469a-b9fb-2cde48a8555c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:15.154444 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-701a097c-92ea-469a-b9fb-2cde48a8555c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:15.167419 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5fb022de-1054-4428-a7cf-3eb22bf6d72f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:15.175067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5fb022de-1054-4428-a7cf-3eb22bf6d72f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1318 microversion: 2.1 time: 0.190588 Aug 12 06:52:15.175634 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 276/541] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:14 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:52:15.188557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-630dc8e9-a743-4840-ae22-0bb09ecc2f44 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:15.188557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-630dc8e9-a743-4840-ae22-0bb09ecc2f44 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:15.188557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:15.188557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630dc8e9-a743-4840-ae22-0bb09ecc2f44 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:15.188961 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630dc8e9-a743-4840-ae22-0bb09ecc2f44 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:15.188961 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630dc8e9-a743-4840-ae22-0bb09ecc2f44 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:15.189173 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630dc8e9-a743-4840-ae22-0bb09ecc2f44 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:15.189550 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630dc8e9-a743-4840-ae22-0bb09ecc2f44 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:15.189963 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630dc8e9-a743-4840-ae22-0bb09ecc2f44 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:15.286811 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-630dc8e9-a743-4840-ae22-0bb09ecc2f44 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109945 Aug 12 06:52:15.287568 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 277/542] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 06:52:15 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:15.325059 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-701a097c-92ea-469a-b9fb-2cde48a8555c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:15.333548 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-701a097c-92ea-469a-b9fb-2cde48a8555c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.192975 Aug 12 06:52:15.334187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 266/543] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:15 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:15.860944 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:15.861533 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:15.870488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:15.871111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:15.872354 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:15.873569 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:15.874119 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:15.874611 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:15.888805 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] HTTP exception thrown: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Request method failure captured: Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 HTTP/1.1 Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9fehQS08eVeSs8c_ZbM5y2ty1SWri2ObrC6X3SMBZekwjzd4U_BMyBmByRCugl1I0lKWdLIF6yPas4HE5GCdOZV-hBFeA32kKwK_i-t5DdEwU0m-IZKMjuS-eOBtDNsWQTvhsbzFgHnmAScZXV7yAACDAIvxYQKuoaWsrIrRI9gDkHc Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:52:15.890470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f03ba37e3ca430d8f7777a28b2819d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 4f4a5b4ebab2440faab418f58b87942f Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:52:15.892066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': 'a6bc12e0-d758-47a7-920d-971a6e993711'} Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:52:15.892926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:52:15.894524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:52:15.896092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Returning 404 to user: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:52:15.896092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c55dade7-b4dc-4d9f-b27c-173f6c8f7566 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 404 len: 111 microversion: 2.20 time: 0.038772 Aug 12 06:52:15.897120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 278/544] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:15 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 06:52:15.902021 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e0b1f996-0d73-42db-b7a2-8bcd7bd054cb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '.version_select at 0x7fc704623c10>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:15.923492 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e0b1f996-0d73-42db-b7a2-8bcd7bd054cb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768940355" status: 204 len: 0 microversion: 2.20 time: 0.025475 Aug 12 06:52:15.924165 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 267/545] 10.222.0.20 () {60 vars in 1262 bytes} [Fri Aug 12 06:52:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768940355 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 06:52:16.197690 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ac999dc1-e3ed-4b76-9013-9de317033f34 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:16.198310 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ac999dc1-e3ed-4b76-9013-9de317033f34 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:16.207099 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac999dc1-e3ed-4b76-9013-9de317033f34 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:16.208016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac999dc1-e3ed-4b76-9013-9de317033f34 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:16.208650 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac999dc1-e3ed-4b76-9013-9de317033f34 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:16.209467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac999dc1-e3ed-4b76-9013-9de317033f34 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:16.210030 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac999dc1-e3ed-4b76-9013-9de317033f34 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:16.210568 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac999dc1-e3ed-4b76-9013-9de317033f34 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:16.354749 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-dfa87bb9-4fc7-46bc-9e5c-87afa35c73b3 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:16.355511 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-dfa87bb9-4fc7-46bc-9e5c-87afa35c73b3 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:16.364183 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfa87bb9-4fc7-46bc-9e5c-87afa35c73b3 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:16.365107 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfa87bb9-4fc7-46bc-9e5c-87afa35c73b3 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:16.366175 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfa87bb9-4fc7-46bc-9e5c-87afa35c73b3 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:16.367028 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfa87bb9-4fc7-46bc-9e5c-87afa35c73b3 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:16.367895 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfa87bb9-4fc7-46bc-9e5c-87afa35c73b3 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:16.368433 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dfa87bb9-4fc7-46bc-9e5c-87afa35c73b3 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:16.374007 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:16.427808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ac999dc1-e3ed-4b76-9013-9de317033f34 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:16.437412 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ac999dc1-e3ed-4b76-9013-9de317033f34 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1318 microversion: 2.1 time: 0.245288 Aug 12 06:52:16.437981 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 279/546] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:16 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:16.546217 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dfa87bb9-4fc7-46bc-9e5c-87afa35c73b3 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:16.556242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-dfa87bb9-4fc7-46bc-9e5c-87afa35c73b3 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.206250 Aug 12 06:52:16.556962 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 268/547] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:16 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:16.712585 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2eff4d13-c0fd-4857-8774-a9744cc9a263 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Action: 'create', calling method: .version_select at 0x7fc704e98280>, body: {"keypair": {"name": "tempest-keypair-1455843163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvYG+pQQbhEG6jvDxX3JT6itkPqNzVcVi0adsKWmfj0dHHsyTIDwzZJoUU2Yx9+jTx7b1BHTD5leCMJ1//xhe94yZ+5oiD+RhT7fu/fwkRVElvykpErE7I8pWcrY3gXtw=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:16.730422 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-2eff4d13-c0fd-4857-8774-a9744cc9a263 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Getting quotas for project 9f03ba37e3ca430d8f7777a28b2819d3. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:52:16.734903 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-2eff4d13-c0fd-4857-8774-a9744cc9a263 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Getting quotas for user 4f4a5b4ebab2440faab418f58b87942f and project 9f03ba37e3ca430d8f7777a28b2819d3. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:52:16.761005 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2eff4d13-c0fd-4857-8774-a9744cc9a263 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052494 Aug 12 06:52:16.761822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 280/548] 10.222.0.20 () {62 vars in 1200 bytes} [Fri Aug 12 06:52:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 12 06:52:16.838472 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-678c40ba-e314-4baf-8644-f5733df7a9e0 req-745d8ddc-e372-45d2-8600-d5b19d0844ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337150f7-22b7-4d35-9da2-df74b549b5b2", "tag": "0692b8e8-530a-4198-b110-0f594f201062"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:16.848011 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-678c40ba-e314-4baf-8644-f5733df7a9e0 req-745d8ddc-e372-45d2-8600-d5b19d0844ca service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:16.848768 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-678c40ba-e314-4baf-8644-f5733df7a9e0 req-745d8ddc-e372-45d2-8600-d5b19d0844ca service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:16.849286 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-678c40ba-e314-4baf-8644-f5733df7a9e0 req-745d8ddc-e372-45d2-8600-d5b19d0844ca service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:16.861163 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-678c40ba-e314-4baf-8644-f5733df7a9e0 req-745d8ddc-e372-45d2-8600-d5b19d0844ca service nova] Creating event network-changed:0692b8e8-530a-4198-b110-0f594f201062 for instance 337150f7-22b7-4d35-9da2-df74b549b5b2 on hv-cinder-84457 Aug 12 06:52:16.867281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-678c40ba-e314-4baf-8644-f5733df7a9e0 req-745d8ddc-e372-45d2-8600-d5b19d0844ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032787 Aug 12 06:52:16.867995 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 269/549] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:17.458284 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3d2cadaf-b889-490c-bdfa-1990042c21c1 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:17.458910 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3d2cadaf-b889-490c-bdfa-1990042c21c1 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:17.465296 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2cadaf-b889-490c-bdfa-1990042c21c1 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:17.465807 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2cadaf-b889-490c-bdfa-1990042c21c1 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:17.466238 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2cadaf-b889-490c-bdfa-1990042c21c1 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:17.466926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2cadaf-b889-490c-bdfa-1990042c21c1 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:17.467433 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2cadaf-b889-490c-bdfa-1990042c21c1 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:17.467867 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2cadaf-b889-490c-bdfa-1990042c21c1 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:17.578670 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-76693635-5897-4e7c-bfff-76adca88a2c4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:17.579377 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-76693635-5897-4e7c-bfff-76adca88a2c4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:17.586086 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76693635-5897-4e7c-bfff-76adca88a2c4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:17.586666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76693635-5897-4e7c-bfff-76adca88a2c4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:17.587258 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76693635-5897-4e7c-bfff-76adca88a2c4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:17.588153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76693635-5897-4e7c-bfff-76adca88a2c4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:17.588680 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76693635-5897-4e7c-bfff-76adca88a2c4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:17.589176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76693635-5897-4e7c-bfff-76adca88a2c4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:17.702114 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3d2cadaf-b889-490c-bdfa-1990042c21c1 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:17.712135 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3d2cadaf-b889-490c-bdfa-1990042c21c1 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1318 microversion: 2.1 time: 0.258102 Aug 12 06:52:17.713385 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 281/550] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:17 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:17.847705 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-76693635-5897-4e7c-bfff-76adca88a2c4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:17.857701 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-76693635-5897-4e7c-bfff-76adca88a2c4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.283699 Aug 12 06:52:17.858403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 270/551] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:17 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:52:18.256938 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1293644728", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af89cb0b-7b5e-40be-9ba4-4c4bd0c46b2b"}], "security_groups": [{"name": "tempest-securitygroup--1020270077"}], "key_name": "tempest-keypair-1455843163", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:18.361577 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] validate_networks() for [('af89cb0b-7b5e-40be-9ba4-4c4bd0c46b2b', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:52:18.734764 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f0ebaa52-696f-4d08-afd3-4df58d2ac355 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:18.735412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f0ebaa52-696f-4d08-afd3-4df58d2ac355 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:18.742259 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0ebaa52-696f-4d08-afd3-4df58d2ac355 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:18.742744 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0ebaa52-696f-4d08-afd3-4df58d2ac355 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:18.743297 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0ebaa52-696f-4d08-afd3-4df58d2ac355 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:18.744446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0ebaa52-696f-4d08-afd3-4df58d2ac355 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:18.745203 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0ebaa52-696f-4d08-afd3-4df58d2ac355 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:18.745874 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0ebaa52-696f-4d08-afd3-4df58d2ac355 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:18.747399 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:52:18.748109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:52:18.748672 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:52:18.749440 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:52:18.750290 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:52:18.760901 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:18.761459 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:18.761954 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:18.762736 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:18.763215 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:18.763631 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:18.780647 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Getting quotas for project 9f03ba37e3ca430d8f7777a28b2819d3. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:52:18.784518 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Getting quotas for user 4f4a5b4ebab2440faab418f58b87942f and project 9f03ba37e3ca430d8f7777a28b2819d3. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:52:18.796308 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:52:18.798568 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:52:18.847960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7f702634-b546-4887-b3c7-c0395624aca9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.596491 Aug 12 06:52:18.851125 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 282/552] 10.222.0.20 () {62 vars in 1188 bytes} [Fri Aug 12 06:52:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 12 06:52:18.860018 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-88185d9d-701f-4045-ba66-acd9706d083d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:18.860798 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-88185d9d-701f-4045-ba66-acd9706d083d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:18.884672 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f0ebaa52-696f-4d08-afd3-4df58d2ac355 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:18.892444 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f0ebaa52-696f-4d08-afd3-4df58d2ac355 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1318 microversion: 2.1 time: 0.161790 Aug 12 06:52:18.893053 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 271/553] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:18 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:18.898725 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-dd291c54-c866-47dc-99f8-8aa82c466aae tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:18.899574 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-dd291c54-c866-47dc-99f8-8aa82c466aae tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:18.906554 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dd291c54-c866-47dc-99f8-8aa82c466aae tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:18.907351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dd291c54-c866-47dc-99f8-8aa82c466aae tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:18.907784 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dd291c54-c866-47dc-99f8-8aa82c466aae tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:18.908485 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dd291c54-c866-47dc-99f8-8aa82c466aae tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:18.908934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dd291c54-c866-47dc-99f8-8aa82c466aae tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:18.909349 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dd291c54-c866-47dc-99f8-8aa82c466aae tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:18.927272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-88185d9d-701f-4045-ba66-acd9706d083d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:18.935292 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-88185d9d-701f-4045-ba66-acd9706d083d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:18.936895 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-88185d9d-701f-4045-ba66-acd9706d083d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:18.938000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-88185d9d-701f-4045-ba66-acd9706d083d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1282 microversion: 2.20 time: 0.082119 Aug 12 06:52:18.939174 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 283/554] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:18 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:52:19.050366 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dd291c54-c866-47dc-99f8-8aa82c466aae tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:19.059192 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-dd291c54-c866-47dc-99f8-8aa82c466aae tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.164206 Aug 12 06:52:19.059772 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 272/555] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:18 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:19.913824 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-91a1500f-067f-4dbc-9f92-17a44367c015 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:19.914549 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-91a1500f-067f-4dbc-9f92-17a44367c015 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:19.921302 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91a1500f-067f-4dbc-9f92-17a44367c015 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:19.921779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91a1500f-067f-4dbc-9f92-17a44367c015 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:19.922208 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91a1500f-067f-4dbc-9f92-17a44367c015 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:19.922892 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91a1500f-067f-4dbc-9f92-17a44367c015 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:19.923368 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91a1500f-067f-4dbc-9f92-17a44367c015 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:19.923783 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91a1500f-067f-4dbc-9f92-17a44367c015 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:19.961178 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:19.961801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:19.968314 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:19.968785 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:19.969232 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:19.969908 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:19.970383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:19.970783 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:20.054282 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:20.065467 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:20.068215 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:20.070367 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b26e2a0b-2c06-4b70-8921-401ab843774c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1342 microversion: 2.20 time: 0.113457 Aug 12 06:52:20.072091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 273/556] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:19 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1342 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:20.082000 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-634fc7e9-3c47-45c6-aff1-dbd57bca0721 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:20.082600 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-634fc7e9-3c47-45c6-aff1-dbd57bca0721 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:20.090849 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-634fc7e9-3c47-45c6-aff1-dbd57bca0721 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:20.091349 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-634fc7e9-3c47-45c6-aff1-dbd57bca0721 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:20.091791 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-634fc7e9-3c47-45c6-aff1-dbd57bca0721 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:20.092484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-634fc7e9-3c47-45c6-aff1-dbd57bca0721 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:20.092928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-634fc7e9-3c47-45c6-aff1-dbd57bca0721 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:20.093336 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-634fc7e9-3c47-45c6-aff1-dbd57bca0721 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:20.105284 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-91a1500f-067f-4dbc-9f92-17a44367c015 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:20.113048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-91a1500f-067f-4dbc-9f92-17a44367c015 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1318 microversion: 2.1 time: 0.203061 Aug 12 06:52:20.113990 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 284/557] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:19 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:20.232134 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-634fc7e9-3c47-45c6-aff1-dbd57bca0721 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:20.240304 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-634fc7e9-3c47-45c6-aff1-dbd57bca0721 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.162508 Aug 12 06:52:20.240835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 274/558] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:20 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:21.094175 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:21.095543 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:21.102625 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:21.103121 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:21.103525 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:21.104465 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:21.105131 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:21.105786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:21.123044 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:21.133375 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-81aef2a3-84aa-4f1f-b396-075a10e641ab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:21.134798 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-81aef2a3-84aa-4f1f-b396-075a10e641ab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:21.141894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-81aef2a3-84aa-4f1f-b396-075a10e641ab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:21.142918 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-81aef2a3-84aa-4f1f-b396-075a10e641ab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:21.153002 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-81aef2a3-84aa-4f1f-b396-075a10e641ab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:21.157637 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-81aef2a3-84aa-4f1f-b396-075a10e641ab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:21.163067 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-81aef2a3-84aa-4f1f-b396-075a10e641ab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:21.164209 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-81aef2a3-84aa-4f1f-b396-075a10e641ab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:21.297476 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:21.309456 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:21.311658 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:21.312928 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-55558e37-806d-41f3-8090-64b27edc3997 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1408 microversion: 2.20 time: 0.222711 Aug 12 06:52:21.313838 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 285/559] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:21 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:21.318427 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-def41db6-e806-4004-8590-f68bf19b4168 req-809ae434-9674-46f4-8c84-328dbcd1474a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7670ae99-2d30-43e4-96ee-381e4325ac3e", "name": "network-vif-plugged", "status": "completed", "tag": "743534c4-f606-4de9-b908-d3d903041395"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:21.330725 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-def41db6-e806-4004-8590-f68bf19b4168 req-809ae434-9674-46f4-8c84-328dbcd1474a service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:21.331722 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-def41db6-e806-4004-8590-f68bf19b4168 req-809ae434-9674-46f4-8c84-328dbcd1474a service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:21.332442 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-def41db6-e806-4004-8590-f68bf19b4168 req-809ae434-9674-46f4-8c84-328dbcd1474a service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:21.347122 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-def41db6-e806-4004-8590-f68bf19b4168 req-809ae434-9674-46f4-8c84-328dbcd1474a service nova] Creating event network-vif-plugged:743534c4-f606-4de9-b908-d3d903041395 for instance 7670ae99-2d30-43e4-96ee-381e4325ac3e on hv-cinder-84457 Aug 12 06:52:21.352730 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-def41db6-e806-4004-8590-f68bf19b4168 req-809ae434-9674-46f4-8c84-328dbcd1474a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037555 Aug 12 06:52:21.356635 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 286/560] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:21.359856 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-81aef2a3-84aa-4f1f-b396-075a10e641ab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:21.364345 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-372ce0f2-e581-4b91-97e4-9b59daf39570 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:21.366020 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-372ce0f2-e581-4b91-97e4-9b59daf39570 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:21.376833 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372ce0f2-e581-4b91-97e4-9b59daf39570 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:21.377579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372ce0f2-e581-4b91-97e4-9b59daf39570 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:21.377982 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-81aef2a3-84aa-4f1f-b396-075a10e641ab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1318 microversion: 2.1 time: 0.247426 Aug 12 06:52:21.378192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372ce0f2-e581-4b91-97e4-9b59daf39570 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:21.379477 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372ce0f2-e581-4b91-97e4-9b59daf39570 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:21.379621 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 275/561] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:21 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:52:21.380394 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372ce0f2-e581-4b91-97e4-9b59daf39570 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:21.381387 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-372ce0f2-e581-4b91-97e4-9b59daf39570 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:21.520688 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-372ce0f2-e581-4b91-97e4-9b59daf39570 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:21.533665 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-372ce0f2-e581-4b91-97e4-9b59daf39570 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1676 microversion: 2.1 time: 0.175379 Aug 12 06:52:21.534957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 287/562] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:21 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:21.566294 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-7a559fb0-4652-4bad-83d7-8225d7a9d79f req-57ded079-23e2-49bb-acc6-37d0a4b3d603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0893bde6-8eaf-4ca0-95bb-0c04c57e158e", "tag": "4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:21.571934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:21.572667 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:21.582616 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-7a559fb0-4652-4bad-83d7-8225d7a9d79f req-57ded079-23e2-49bb-acc6-37d0a4b3d603 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:21.583258 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-7a559fb0-4652-4bad-83d7-8225d7a9d79f req-57ded079-23e2-49bb-acc6-37d0a4b3d603 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:21.583780 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-7a559fb0-4652-4bad-83d7-8225d7a9d79f req-57ded079-23e2-49bb-acc6-37d0a4b3d603 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:21.595066 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-7a559fb0-4652-4bad-83d7-8225d7a9d79f req-57ded079-23e2-49bb-acc6-37d0a4b3d603 service nova] Creating event network-changed:4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc for instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e on hv-cinder-84457 Aug 12 06:52:21.600918 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-7a559fb0-4652-4bad-83d7-8225d7a9d79f req-57ded079-23e2-49bb-acc6-37d0a4b3d603 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038305 Aug 12 06:52:21.601868 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 276/563] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:22.335896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:22.336453 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:22.342936 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:22.343435 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:22.343863 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:22.344547 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:22.344996 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:22.345413 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:22.402096 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1748fa14-f528-4db4-b52e-b23c80f1a4fd tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:22.402797 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1748fa14-f528-4db4-b52e-b23c80f1a4fd tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:22.410025 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1748fa14-f528-4db4-b52e-b23c80f1a4fd tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:22.410564 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1748fa14-f528-4db4-b52e-b23c80f1a4fd tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:22.411027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1748fa14-f528-4db4-b52e-b23c80f1a4fd tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:22.411714 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1748fa14-f528-4db4-b52e-b23c80f1a4fd tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:22.412179 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1748fa14-f528-4db4-b52e-b23c80f1a4fd tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:22.412627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1748fa14-f528-4db4-b52e-b23c80f1a4fd tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:22.563015 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:22.571565 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:22.573039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:22.574126 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8ec0e3cc-fdb7-4f0b-9e5e-cc84bd92e3ea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1408 microversion: 2.20 time: 0.242380 Aug 12 06:52:22.574693 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 288/564] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:22 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:22.579064 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-adb4a7f0-87dd-4ce7-b4eb-f1819c451c35 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:22.579657 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-adb4a7f0-87dd-4ce7-b4eb-f1819c451c35 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:22.585720 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adb4a7f0-87dd-4ce7-b4eb-f1819c451c35 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:22.586261 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adb4a7f0-87dd-4ce7-b4eb-f1819c451c35 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:22.586625 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adb4a7f0-87dd-4ce7-b4eb-f1819c451c35 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:22.587323 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adb4a7f0-87dd-4ce7-b4eb-f1819c451c35 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:22.587766 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adb4a7f0-87dd-4ce7-b4eb-f1819c451c35 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:22.588179 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adb4a7f0-87dd-4ce7-b4eb-f1819c451c35 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:22.956890 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1748fa14-f528-4db4-b52e-b23c80f1a4fd tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:22.964829 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1748fa14-f528-4db4-b52e-b23c80f1a4fd tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1318 microversion: 2.1 time: 0.567444 Aug 12 06:52:22.965675 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 277/565] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:22 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:23.012168 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-adb4a7f0-87dd-4ce7-b4eb-f1819c451c35 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:23.023844 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-adb4a7f0-87dd-4ce7-b4eb-f1819c451c35 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1653 microversion: 2.1 time: 0.447918 Aug 12 06:52:23.024828 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 289/566] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:22 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1653 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:23.051663 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-028049a2-6229-44e2-9974-71c95a59d7d7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:23.061634 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-028049a2-6229-44e2-9974-71c95a59d7d7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:23.062413 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-028049a2-6229-44e2-9974-71c95a59d7d7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:23.063051 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-028049a2-6229-44e2-9974-71c95a59d7d7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:23.088606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-028049a2-6229-44e2-9974-71c95a59d7d7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Going to try to start instance {{(pid=127087) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 12 06:52:23.135233 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-028049a2-6229-44e2-9974-71c95a59d7d7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "POST /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/action" status: 202 len: 0 microversion: 2.1 time: 0.088144 Aug 12 06:52:23.135830 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 278/567] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:52:23 2022] POST /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:52:23.144141 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ff7f14b7-1a7f-410c-8334-2c67ac4456e0 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:23.145146 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ff7f14b7-1a7f-410c-8334-2c67ac4456e0 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:23.151359 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff7f14b7-1a7f-410c-8334-2c67ac4456e0 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:23.151842 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff7f14b7-1a7f-410c-8334-2c67ac4456e0 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:23.152269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff7f14b7-1a7f-410c-8334-2c67ac4456e0 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:23.152960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff7f14b7-1a7f-410c-8334-2c67ac4456e0 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:23.153409 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff7f14b7-1a7f-410c-8334-2c67ac4456e0 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:23.153825 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff7f14b7-1a7f-410c-8334-2c67ac4456e0 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:23.292609 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ff7f14b7-1a7f-410c-8334-2c67ac4456e0 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:23.300558 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ff7f14b7-1a7f-410c-8334-2c67ac4456e0 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1662 microversion: 2.1 time: 0.160347 Aug 12 06:52:23.301346 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 290/568] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:23 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1662 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:23.602378 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:23.603550 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:23.613790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:23.614619 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:23.615335 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:23.616508 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:23.617295 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:23.617710 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:23.759651 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:23.767630 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:23.769035 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:23.770436 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-72f9db0a-3989-4aba-8f00-e3eb5279fca3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1408 microversion: 2.20 time: 0.175642 Aug 12 06:52:23.770966 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 279/569] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:23 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:23.989763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a14d583e-1042-4906-8ad1-2b571adcda84 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:23.990699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a14d583e-1042-4906-8ad1-2b571adcda84 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:24.001579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a14d583e-1042-4906-8ad1-2b571adcda84 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:24.002379 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a14d583e-1042-4906-8ad1-2b571adcda84 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:24.003130 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a14d583e-1042-4906-8ad1-2b571adcda84 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:24.004282 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a14d583e-1042-4906-8ad1-2b571adcda84 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:24.005027 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a14d583e-1042-4906-8ad1-2b571adcda84 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:24.005723 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a14d583e-1042-4906-8ad1-2b571adcda84 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:24.132701 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a14d583e-1042-4906-8ad1-2b571adcda84 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:24.140333 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a14d583e-1042-4906-8ad1-2b571adcda84 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1507 microversion: 2.1 time: 0.157134 Aug 12 06:52:24.140903 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 291/570] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:23 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:24.160998 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-10bb4c12-29a3-4937-9a75-17c261f15aab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f40d693-2e4e-4d3f-8d6b-b15c153316be", "device": "/dev/sdb"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:24.165895 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-10bb4c12-29a3-4937-9a75-17c261f15aab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:24.170599 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10bb4c12-29a3-4937-9a75-17c261f15aab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:24.171152 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10bb4c12-29a3-4937-9a75-17c261f15aab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:24.171577 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10bb4c12-29a3-4937-9a75-17c261f15aab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:24.172269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10bb4c12-29a3-4937-9a75-17c261f15aab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:24.172688 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10bb4c12-29a3-4937-9a75-17c261f15aab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:24.173100 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10bb4c12-29a3-4937-9a75-17c261f15aab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:24.325508 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3261117f-b69c-4571-ae4d-fcf21ccabda1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:24.326494 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3261117f-b69c-4571-ae4d-fcf21ccabda1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:24.336407 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3261117f-b69c-4571-ae4d-fcf21ccabda1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:24.336822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3261117f-b69c-4571-ae4d-fcf21ccabda1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:24.337255 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3261117f-b69c-4571-ae4d-fcf21ccabda1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:24.337942 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3261117f-b69c-4571-ae4d-fcf21ccabda1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:24.338388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3261117f-b69c-4571-ae4d-fcf21ccabda1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:24.338816 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3261117f-b69c-4571-ae4d-fcf21ccabda1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:24.567427 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3261117f-b69c-4571-ae4d-fcf21ccabda1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:24.580029 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3261117f-b69c-4571-ae4d-fcf21ccabda1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1662 microversion: 2.1 time: 0.260967 Aug 12 06:52:24.581270 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 292/571] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:24 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1662 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:24.605555 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-10bb4c12-29a3-4937-9a75-17c261f15aab tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "POST /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448272 Aug 12 06:52:24.606179 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 280/572] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:52:24 2022] POST /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:24.794545 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:24.795699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:24.802898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:24.803554 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:24.804337 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:24.805289 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:24.806174 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:24.807037 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:25.050004 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:25.058364 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:25.059907 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:25.061041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bc02adda-44d6-4906-b2b4-21abbe142750 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1408 microversion: 2.20 time: 0.271765 Aug 12 06:52:25.061867 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 293/573] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:24 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:25.605877 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2dce4045-4924-48d7-aab8-ce886824353d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:25.606779 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2dce4045-4924-48d7-aab8-ce886824353d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:25.615763 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2dce4045-4924-48d7-aab8-ce886824353d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:25.616395 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2dce4045-4924-48d7-aab8-ce886824353d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:25.617062 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2dce4045-4924-48d7-aab8-ce886824353d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:25.617748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2dce4045-4924-48d7-aab8-ce886824353d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:25.618316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2dce4045-4924-48d7-aab8-ce886824353d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:25.618768 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2dce4045-4924-48d7-aab8-ce886824353d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:25.759475 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2dce4045-4924-48d7-aab8-ce886824353d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:25.767706 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2dce4045-4924-48d7-aab8-ce886824353d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1662 microversion: 2.1 time: 0.168745 Aug 12 06:52:25.768383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 281/574] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:25 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1662 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:26.088202 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:26.089041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:26.099969 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:26.100750 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:26.101518 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:26.102198 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:26.102671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:26.103118 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:26.238849 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:26.247382 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:26.248854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:26.249949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6ff36e3e-b945-4bd3-9545-2fff31ef2209 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1408 microversion: 2.20 time: 0.168528 Aug 12 06:52:26.250516 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 294/575] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:26 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:26.789876 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4a452cd6-36ae-4217-81a3-24b51dd30815 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:26.790479 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4a452cd6-36ae-4217-81a3-24b51dd30815 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:26.798475 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4a452cd6-36ae-4217-81a3-24b51dd30815 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:26.798956 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4a452cd6-36ae-4217-81a3-24b51dd30815 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:26.799442 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4a452cd6-36ae-4217-81a3-24b51dd30815 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:26.800301 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4a452cd6-36ae-4217-81a3-24b51dd30815 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:26.800749 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4a452cd6-36ae-4217-81a3-24b51dd30815 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:26.801205 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4a452cd6-36ae-4217-81a3-24b51dd30815 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:26.938736 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4a452cd6-36ae-4217-81a3-24b51dd30815 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:26.946595 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4a452cd6-36ae-4217-81a3-24b51dd30815 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1666 microversion: 2.1 time: 0.160672 Aug 12 06:52:26.947209 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 282/576] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:26 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:27.274209 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:27.274940 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:27.282016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:27.282439 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:27.282851 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:27.283642 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:27.284089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:27.284525 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:27.418251 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:27.427791 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:27.429394 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:27.430506 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7f0e6355-3eeb-4e4a-b801-fe2c514840fa tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1408 microversion: 2.20 time: 0.160781 Aug 12 06:52:27.431131 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 295/577] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:27 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:52:28.457503 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:28.458316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:28.469091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:28.469889 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:28.470589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:28.471744 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:28.472484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:28.473170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:28.605356 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:28.611148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:28.618876 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:28.620379 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:28.621487 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1ffca769-75e8-4e59-a2e9-303a1b908c2f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1408 microversion: 2.20 time: 0.170814 Aug 12 06:52:28.622046 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 283/578] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:28 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:29.210228 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-b95f579d-2cba-4162-9257-bfe914d4362e req-5892e3d1-376f-4fe8-8e0c-c1393f4dee51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0893bde6-8eaf-4ca0-95bb-0c04c57e158e", "name": "network-vif-plugged", "status": "completed", "tag": "4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:29.216582 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:29.217366 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=14 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:29.223725 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b95f579d-2cba-4162-9257-bfe914d4362e req-5892e3d1-376f-4fe8-8e0c-c1393f4dee51 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:29.224198 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b95f579d-2cba-4162-9257-bfe914d4362e req-5892e3d1-376f-4fe8-8e0c-c1393f4dee51 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:29.224639 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b95f579d-2cba-4162-9257-bfe914d4362e req-5892e3d1-376f-4fe8-8e0c-c1393f4dee51 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:29.235886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-b95f579d-2cba-4162-9257-bfe914d4362e req-5892e3d1-376f-4fe8-8e0c-c1393f4dee51 service nova] Creating event network-vif-plugged:4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc for instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e on hv-cinder-84457 Aug 12 06:52:29.240718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-b95f579d-2cba-4162-9257-bfe914d4362e req-5892e3d1-376f-4fe8-8e0c-c1393f4dee51 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034276 Aug 12 06:52:29.241699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 296/579] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:29.647994 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:29.649009 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:29.656644 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:29.657082 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:29.657541 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:29.658206 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:29.658650 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:29.659093 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:29.805344 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:29.814072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:29.815680 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:29.816805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-682d8c0b-3905-4845-b7c9-ae19352eb0a0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1408 microversion: 2.20 time: 0.175809 Aug 12 06:52:29.817425 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 284/580] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:29 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:30.845510 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:30.846526 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:30.856973 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:30.857798 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:30.858455 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:30.859778 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:30.860533 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:30.861263 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:31.003432 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:31.011871 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:31.013356 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:31.014486 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c0256ce6-95d3-4299-96bc-7afccf74b502 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1408 microversion: 2.20 time: 0.177140 Aug 12 06:52:31.015297 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 297/581] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:30 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:32.041511 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:32.042254 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:32.051329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:32.052086 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:32.052670 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:32.053354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:32.053973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:32.054526 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:32.187569 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:32.195631 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:32.197116 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:32.198259 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c4563043-3b9b-4feb-a228-29f97d7a86ef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1601 microversion: 2.20 time: 0.163100 Aug 12 06:52:32.198822 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 285/582] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:52:32 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:52:32.220120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-81e3f652-82d7-4a90-9bcc-7df12cba5ec0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:32.220655 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-81e3f652-82d7-4a90-9bcc-7df12cba5ec0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:32.227289 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81e3f652-82d7-4a90-9bcc-7df12cba5ec0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:32.227771 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81e3f652-82d7-4a90-9bcc-7df12cba5ec0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:32.228201 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81e3f652-82d7-4a90-9bcc-7df12cba5ec0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:32.228908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81e3f652-82d7-4a90-9bcc-7df12cba5ec0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:32.229355 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81e3f652-82d7-4a90-9bcc-7df12cba5ec0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:32.229772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81e3f652-82d7-4a90-9bcc-7df12cba5ec0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:32.310930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-81e3f652-82d7-4a90-9bcc-7df12cba5ec0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094659 Aug 12 06:52:32.311823 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 298/583] 10.222.0.20 () {60 vars in 1316 bytes} [Fri Aug 12 06:52:32 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:52:33.270788 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-5ae50a04-ae09-4ec1-ad82-5ce475fd5dde req-1503f255-61b0-4fa1-9498-3807fd988f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0893bde6-8eaf-4ca0-95bb-0c04c57e158e", "tag": "4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:33.280995 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-5ae50a04-ae09-4ec1-ad82-5ce475fd5dde req-1503f255-61b0-4fa1-9498-3807fd988f97 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:33.281587 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-5ae50a04-ae09-4ec1-ad82-5ce475fd5dde req-1503f255-61b0-4fa1-9498-3807fd988f97 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:33.282314 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-5ae50a04-ae09-4ec1-ad82-5ce475fd5dde req-1503f255-61b0-4fa1-9498-3807fd988f97 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:33.293243 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-5ae50a04-ae09-4ec1-ad82-5ce475fd5dde req-1503f255-61b0-4fa1-9498-3807fd988f97 service nova] Creating event network-changed:4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc for instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e on hv-cinder-84457 Aug 12 06:52:33.298419 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-5ae50a04-ae09-4ec1-ad82-5ce475fd5dde req-1503f255-61b0-4fa1-9498-3807fd988f97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031625 Aug 12 06:52:33.299336 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 286/584] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:41.727256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9bc44665-d6f9-4829-a3a0-86c44deac1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:41.727760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9bc44665-d6f9-4829-a3a0-86c44deac1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:41.734218 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bc44665-d6f9-4829-a3a0-86c44deac1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:41.734699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bc44665-d6f9-4829-a3a0-86c44deac1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:41.735157 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bc44665-d6f9-4829-a3a0-86c44deac1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:41.735842 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bc44665-d6f9-4829-a3a0-86c44deac1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:41.736284 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bc44665-d6f9-4829-a3a0-86c44deac1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:41.736700 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bc44665-d6f9-4829-a3a0-86c44deac1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:41.820050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-9bc44665-d6f9-4829-a3a0-86c44deac1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lazy-loading 'services' on Instance uuid 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:52:41.894497 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9bc44665-d6f9-4829-a3a0-86c44deac1bb tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments/7f538766-788b-4247-ae2f-37f4d803bdbb" status: 202 len: 0 microversion: 2.1 time: 0.171829 Aug 12 06:52:41.895516 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 299/585] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:52:41 2022] DELETE /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments/7f538766-788b-4247-ae2f-37f4d803bdbb => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:52:41.904433 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6cb6890a-b19c-4e21-a4d7-8ae8810381d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:41.906734 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6cb6890a-b19c-4e21-a4d7-8ae8810381d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:41.909292 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:41.915889 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cb6890a-b19c-4e21-a4d7-8ae8810381d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:41.916494 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cb6890a-b19c-4e21-a4d7-8ae8810381d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:41.917128 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cb6890a-b19c-4e21-a4d7-8ae8810381d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:41.917867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cb6890a-b19c-4e21-a4d7-8ae8810381d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:41.918447 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cb6890a-b19c-4e21-a4d7-8ae8810381d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:41.918870 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cb6890a-b19c-4e21-a4d7-8ae8810381d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:41.949391 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6cb6890a-b19c-4e21-a4d7-8ae8810381d9 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049200 Aug 12 06:52:41.949931 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 287/586] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:52:41 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:42.964187 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ad510d78-cff9-4ca5-9347-ff57108505e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:42.965855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ad510d78-cff9-4ca5-9347-ff57108505e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:42.972607 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad510d78-cff9-4ca5-9347-ff57108505e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:42.973092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad510d78-cff9-4ca5-9347-ff57108505e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:42.973523 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad510d78-cff9-4ca5-9347-ff57108505e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:42.974233 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad510d78-cff9-4ca5-9347-ff57108505e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:42.974679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad510d78-cff9-4ca5-9347-ff57108505e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:42.975119 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad510d78-cff9-4ca5-9347-ff57108505e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:43.005003 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ad510d78-cff9-4ca5-9347-ff57108505e5 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046596 Aug 12 06:52:43.005590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 300/587] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:52:42 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:44.022252 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1be06299-2870-4592-ab36-92de28929191 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:44.022968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1be06299-2870-4592-ab36-92de28929191 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:44.030514 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1be06299-2870-4592-ab36-92de28929191 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:44.031003 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1be06299-2870-4592-ab36-92de28929191 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:44.031451 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1be06299-2870-4592-ab36-92de28929191 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:44.032105 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1be06299-2870-4592-ab36-92de28929191 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:44.032584 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1be06299-2870-4592-ab36-92de28929191 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:44.032996 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1be06299-2870-4592-ab36-92de28929191 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:44.061896 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1be06299-2870-4592-ab36-92de28929191 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046995 Aug 12 06:52:44.062452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 288/588] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:52:44 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 06:52:44.147653 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-be43b2d9-589d-4180-89b7-6acfde972877 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:44.148212 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-be43b2d9-589d-4180-89b7-6acfde972877 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:44.155048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be43b2d9-589d-4180-89b7-6acfde972877 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:44.155523 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be43b2d9-589d-4180-89b7-6acfde972877 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:44.155959 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be43b2d9-589d-4180-89b7-6acfde972877 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:44.156649 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be43b2d9-589d-4180-89b7-6acfde972877 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:44.157104 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be43b2d9-589d-4180-89b7-6acfde972877 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:44.157526 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be43b2d9-589d-4180-89b7-6acfde972877 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:44.184283 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-be43b2d9-589d-4180-89b7-6acfde972877 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:52:44.233406 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:44.267966 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-be43b2d9-589d-4180-89b7-6acfde972877 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 204 len: 0 microversion: 2.1 time: 0.124399 Aug 12 06:52:44.268780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 301/589] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:52:44 2022] DELETE /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:52:44.277859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bd1bc5b0-cd83-4e41-aca1-3d3d64ef5ad0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:44.278519 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bd1bc5b0-cd83-4e41-aca1-3d3d64ef5ad0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:44.284415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd1bc5b0-cd83-4e41-aca1-3d3d64ef5ad0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:44.284886 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd1bc5b0-cd83-4e41-aca1-3d3d64ef5ad0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:44.285307 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd1bc5b0-cd83-4e41-aca1-3d3d64ef5ad0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:44.285980 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd1bc5b0-cd83-4e41-aca1-3d3d64ef5ad0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:44.286422 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd1bc5b0-cd83-4e41-aca1-3d3d64ef5ad0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:44.286828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd1bc5b0-cd83-4e41-aca1-3d3d64ef5ad0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:44.547792 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd1bc5b0-cd83-4e41-aca1-3d3d64ef5ad0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:44.555633 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bd1bc5b0-cd83-4e41-aca1-3d3d64ef5ad0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1689 microversion: 2.1 time: 0.281809 Aug 12 06:52:44.556199 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 289/590] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:44 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1689 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:45.155831 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4f624210-63dc-4dda-97d6-cd85f964c264 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:45.156409 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4f624210-63dc-4dda-97d6-cd85f964c264 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:45.163188 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f624210-63dc-4dda-97d6-cd85f964c264 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:45.163672 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f624210-63dc-4dda-97d6-cd85f964c264 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:45.164098 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f624210-63dc-4dda-97d6-cd85f964c264 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:45.164790 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f624210-63dc-4dda-97d6-cd85f964c264 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:45.165237 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f624210-63dc-4dda-97d6-cd85f964c264 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:45.165655 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f624210-63dc-4dda-97d6-cd85f964c264 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:45.252031 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-4f624210-63dc-4dda-97d6-cd85f964c264 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lazy-loading 'services' on Instance uuid 7670ae99-2d30-43e4-96ee-381e4325ac3e {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:52:45.329403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4f624210-63dc-4dda-97d6-cd85f964c264 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e/os-volume_attachments/6f40d693-2e4e-4d3f-8d6b-b15c153316be" status: 202 len: 0 microversion: 2.1 time: 0.177657 Aug 12 06:52:45.330361 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 302/591] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:52:45 2022] DELETE /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e/os-volume_attachments/6f40d693-2e4e-4d3f-8d6b-b15c153316be => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:52:45.580706 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5e51902d-2747-4a75-ad2e-da7526a83f6c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:45.581684 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5e51902d-2747-4a75-ad2e-da7526a83f6c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:45.592386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e51902d-2747-4a75-ad2e-da7526a83f6c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:45.593187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e51902d-2747-4a75-ad2e-da7526a83f6c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:45.593909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e51902d-2747-4a75-ad2e-da7526a83f6c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:45.595050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e51902d-2747-4a75-ad2e-da7526a83f6c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:45.595788 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e51902d-2747-4a75-ad2e-da7526a83f6c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:45.596475 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e51902d-2747-4a75-ad2e-da7526a83f6c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:45.742905 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e51902d-2747-4a75-ad2e-da7526a83f6c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:45.750623 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5e51902d-2747-4a75-ad2e-da7526a83f6c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1689 microversion: 2.1 time: 0.176482 Aug 12 06:52:45.751217 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 290/592] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:45 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:46.777958 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6814c730-7aa6-44fa-a441-626c84db8e2c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:46.779132 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6814c730-7aa6-44fa-a441-626c84db8e2c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:46.782158 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:52:46.791917 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6814c730-7aa6-44fa-a441-626c84db8e2c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:46.792826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6814c730-7aa6-44fa-a441-626c84db8e2c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:46.793432 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6814c730-7aa6-44fa-a441-626c84db8e2c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:46.794584 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6814c730-7aa6-44fa-a441-626c84db8e2c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:46.795367 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6814c730-7aa6-44fa-a441-626c84db8e2c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:46.796050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6814c730-7aa6-44fa-a441-626c84db8e2c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:46.995336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6814c730-7aa6-44fa-a441-626c84db8e2c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:47.003011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6814c730-7aa6-44fa-a441-626c84db8e2c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1689 microversion: 2.1 time: 0.233248 Aug 12 06:52:47.003586 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 303/593] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:46 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1689 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:48.028639 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ad9279fb-125c-43ce-9413-065be1513c2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:48.029542 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ad9279fb-125c-43ce-9413-065be1513c2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:48.039859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9279fb-125c-43ce-9413-065be1513c2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:48.040340 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9279fb-125c-43ce-9413-065be1513c2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:48.040764 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9279fb-125c-43ce-9413-065be1513c2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:48.041446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9279fb-125c-43ce-9413-065be1513c2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:48.041887 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9279fb-125c-43ce-9413-065be1513c2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:48.042300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9279fb-125c-43ce-9413-065be1513c2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:48.185983 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ad9279fb-125c-43ce-9413-065be1513c2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:48.195242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ad9279fb-125c-43ce-9413-065be1513c2e tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1689 microversion: 2.1 time: 0.172869 Aug 12 06:52:48.195784 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 291/594] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:48 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:49.215906 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e0665f93-31a3-44ee-bc10-f0f8da004aaf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:49.216455 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e0665f93-31a3-44ee-bc10-f0f8da004aaf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:49.223313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0665f93-31a3-44ee-bc10-f0f8da004aaf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:49.223799 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0665f93-31a3-44ee-bc10-f0f8da004aaf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:49.224226 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0665f93-31a3-44ee-bc10-f0f8da004aaf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:49.224915 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0665f93-31a3-44ee-bc10-f0f8da004aaf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:49.225414 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0665f93-31a3-44ee-bc10-f0f8da004aaf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:49.225813 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0665f93-31a3-44ee-bc10-f0f8da004aaf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:49.359369 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e0665f93-31a3-44ee-bc10-f0f8da004aaf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:49.367091 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e0665f93-31a3-44ee-bc10-f0f8da004aaf tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1689 microversion: 2.1 time: 0.155147 Aug 12 06:52:49.367663 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 304/595] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:49 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:49.700824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9c86fedf-71a9-4d21-97a5-345869cf2ad6 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:49.701379 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9c86fedf-71a9-4d21-97a5-345869cf2ad6 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:49.708146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c86fedf-71a9-4d21-97a5-345869cf2ad6 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:49.708636 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c86fedf-71a9-4d21-97a5-345869cf2ad6 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:49.709071 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c86fedf-71a9-4d21-97a5-345869cf2ad6 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:49.709763 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c86fedf-71a9-4d21-97a5-345869cf2ad6 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:49.710227 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c86fedf-71a9-4d21-97a5-345869cf2ad6 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:49.710677 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c86fedf-71a9-4d21-97a5-345869cf2ad6 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:49.735358 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9c86fedf-71a9-4d21-97a5-345869cf2ad6 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:52:49.822338 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9c86fedf-71a9-4d21-97a5-345869cf2ad6 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 204 len: 0 microversion: 2.1 time: 0.125154 Aug 12 06:52:49.822989 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 292/596] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:52:49 2022] DELETE /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:52:49.836042 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2dcd14ae-dca3-4d48-8943-ba3fd3e6e76b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:49.836787 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2dcd14ae-dca3-4d48-8943-ba3fd3e6e76b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:49.844040 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dcd14ae-dca3-4d48-8943-ba3fd3e6e76b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:49.844619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dcd14ae-dca3-4d48-8943-ba3fd3e6e76b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:49.845270 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dcd14ae-dca3-4d48-8943-ba3fd3e6e76b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:49.846087 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dcd14ae-dca3-4d48-8943-ba3fd3e6e76b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:49.846609 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dcd14ae-dca3-4d48-8943-ba3fd3e6e76b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:49.847123 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dcd14ae-dca3-4d48-8943-ba3fd3e6e76b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:49.847338 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-5a5143bb-c0e6-4a8c-8159-09ea33346f7e req-d40d602b-2265-4bea-b47e-e9dc6c930b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1d2c7f-0786-4d54-8a52-d1d3deac1f29", "name": "network-vif-deleted", "tag": "09e645cd-262e-494b-8463-19e7e2065876"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:49.856700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-5a5143bb-c0e6-4a8c-8159-09ea33346f7e req-d40d602b-2265-4bea-b47e-e9dc6c930b9a service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:49.857176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-5a5143bb-c0e6-4a8c-8159-09ea33346f7e req-d40d602b-2265-4bea-b47e-e9dc6c930b9a service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:49.857601 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-5a5143bb-c0e6-4a8c-8159-09ea33346f7e req-d40d602b-2265-4bea-b47e-e9dc6c930b9a service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:49.868986 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-5a5143bb-c0e6-4a8c-8159-09ea33346f7e req-d40d602b-2265-4bea-b47e-e9dc6c930b9a service nova] Creating event network-vif-deleted:09e645cd-262e-494b-8463-19e7e2065876 for instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 on hv-cinder-84457 Aug 12 06:52:49.873918 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-5a5143bb-c0e6-4a8c-8159-09ea33346f7e req-d40d602b-2265-4bea-b47e-e9dc6c930b9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030879 Aug 12 06:52:49.874520 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 293/597] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:49.987270 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2dcd14ae-dca3-4d48-8943-ba3fd3e6e76b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:49.995490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2dcd14ae-dca3-4d48-8943-ba3fd3e6e76b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1513 microversion: 2.1 time: 0.167555 Aug 12 06:52:49.996090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 305/598] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:49 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:50.389238 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4bf1a1cd-9f99-48e6-a5ef-7df5c240aec2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:50.389829 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4bf1a1cd-9f99-48e6-a5ef-7df5c240aec2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:50.396844 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4bf1a1cd-9f99-48e6-a5ef-7df5c240aec2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:50.397329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4bf1a1cd-9f99-48e6-a5ef-7df5c240aec2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:50.397766 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4bf1a1cd-9f99-48e6-a5ef-7df5c240aec2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:50.398527 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4bf1a1cd-9f99-48e6-a5ef-7df5c240aec2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:50.399002 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4bf1a1cd-9f99-48e6-a5ef-7df5c240aec2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:50.399437 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4bf1a1cd-9f99-48e6-a5ef-7df5c240aec2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:50.461798 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4bf1a1cd-9f99-48e6-a5ef-7df5c240aec2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:50.469373 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4bf1a1cd-9f99-48e6-a5ef-7df5c240aec2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1621 microversion: 2.1 time: 0.084503 Aug 12 06:52:50.469991 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 294/599] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:50 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1621 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:51.018136 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-582089e6-2c24-484a-b7fa-07a99b704a9f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:51.018840 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-582089e6-2c24-484a-b7fa-07a99b704a9f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:51.027619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-582089e6-2c24-484a-b7fa-07a99b704a9f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:51.028229 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-582089e6-2c24-484a-b7fa-07a99b704a9f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:51.028852 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-582089e6-2c24-484a-b7fa-07a99b704a9f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:51.029699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-582089e6-2c24-484a-b7fa-07a99b704a9f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:51.030252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-582089e6-2c24-484a-b7fa-07a99b704a9f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:51.030768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-582089e6-2c24-484a-b7fa-07a99b704a9f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:51.173136 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-582089e6-2c24-484a-b7fa-07a99b704a9f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:51.181189 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-582089e6-2c24-484a-b7fa-07a99b704a9f tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1513 microversion: 2.1 time: 0.167969 Aug 12 06:52:51.181758 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 306/600] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:51 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:51.489862 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-67b08284-7ddc-4d24-818b-9d96b2827317 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:51.491105 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-67b08284-7ddc-4d24-818b-9d96b2827317 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:51.498866 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67b08284-7ddc-4d24-818b-9d96b2827317 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:51.503859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67b08284-7ddc-4d24-818b-9d96b2827317 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:51.504326 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67b08284-7ddc-4d24-818b-9d96b2827317 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:51.505041 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67b08284-7ddc-4d24-818b-9d96b2827317 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:51.505495 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67b08284-7ddc-4d24-818b-9d96b2827317 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:51.505911 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67b08284-7ddc-4d24-818b-9d96b2827317 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:51.571357 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-67b08284-7ddc-4d24-818b-9d96b2827317 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:51.581123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-67b08284-7ddc-4d24-818b-9d96b2827317 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 200 len: 1330 microversion: 2.1 time: 0.095155 Aug 12 06:52:51.581678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 295/601] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:51 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:52.202364 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6bc62ebd-bd97-4343-855a-912c670ad088 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:52.203005 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6bc62ebd-bd97-4343-855a-912c670ad088 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:52.210448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bc62ebd-bd97-4343-855a-912c670ad088 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:52.210933 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bc62ebd-bd97-4343-855a-912c670ad088 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:52.211395 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bc62ebd-bd97-4343-855a-912c670ad088 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:52.212245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bc62ebd-bd97-4343-855a-912c670ad088 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:52.212702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bc62ebd-bd97-4343-855a-912c670ad088 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:52.213101 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bc62ebd-bd97-4343-855a-912c670ad088 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:52.358371 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6bc62ebd-bd97-4343-855a-912c670ad088 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84dd7d7aec747b482cadf308411ea61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de24610a31e4f65908ac9f4ca56cbae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:52.369023 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6bc62ebd-bd97-4343-855a-912c670ad088 tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 200 len: 1513 microversion: 2.1 time: 0.170627 Aug 12 06:52:52.369832 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 307/602] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:52 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:52.652112 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-edb3d10d-650e-4181-bb26-4f5689a83af9 req-ed0c0295-caee-4a13-bec4-08da0fb3c54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7670ae99-2d30-43e4-96ee-381e4325ac3e", "name": "network-vif-deleted", "tag": "743534c4-f606-4de9-b908-d3d903041395"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:52:52.661964 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-edb3d10d-650e-4181-bb26-4f5689a83af9 req-ed0c0295-caee-4a13-bec4-08da0fb3c54f service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:52.662754 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-edb3d10d-650e-4181-bb26-4f5689a83af9 req-ed0c0295-caee-4a13-bec4-08da0fb3c54f service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:52.662960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-edb3d10d-650e-4181-bb26-4f5689a83af9 req-ed0c0295-caee-4a13-bec4-08da0fb3c54f service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:52.668646 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:52.669308 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:52.675536 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:52.675995 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:52.676143 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-edb3d10d-650e-4181-bb26-4f5689a83af9 req-ed0c0295-caee-4a13-bec4-08da0fb3c54f service nova] Creating event network-vif-deleted:743534c4-f606-4de9-b908-d3d903041395 for instance 7670ae99-2d30-43e4-96ee-381e4325ac3e on hv-cinder-84457 Aug 12 06:52:52.676426 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:52.677103 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:52.677550 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:52.677961 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:52.681219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-edb3d10d-650e-4181-bb26-4f5689a83af9 req-ed0c0295-caee-4a13-bec4-08da0fb3c54f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037362 Aug 12 06:52:52.682205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 308/603] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:52:52.693789 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] HTTP exception thrown: Instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 could not be found. Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Request method failure captured: Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 HTTP/1.1 Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9feYq1WRxO1Mn164rhUCBzm3LFDxqEbHN0rZaCFppVUvY401Qo_9blAqxE1jSwnwng7ImaGb5PIbVbYQeOFbAubwTc9U1tEAi7xvUnwMVElhSMnvIl7Uh5962LmQALoPj8xHxamxpdP9xZrB6QoQdnWuhnf8Qeu0j7Yg5UC9bC_VafY Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 9871a1ac34bd4164bd662499cf299cbe Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:52:52.695649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9871a1ac34bd4164bd662499cf299cbe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 9871a1ac34bd4164bd662499cf299cbe Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-ServerRescueNegativeTestJSON-1861263750-project Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: cf53f022a26d48b3aa70cea4f5fbc1c3 Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1861263750-project Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 could not be found. Aug 12 06:52:52.697123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '1f1d2c7f-0786-4d54-8a52-d1d3deac1f29'} Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 could not be found. Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:52:52.697894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 could not be found. Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 could not be found. Aug 12 06:52:52.699153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:52.700280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Returning 404 to user: Instance 1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:52:52.700280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-67af968b-1e71-4e9c-885b-7227292faf99 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29" status: 404 len: 111 microversion: 2.1 time: 0.097875 Aug 12 06:52:52.700280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 296/604] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:52 2022] GET /compute/v2.1/servers/1f1d2c7f-0786-4d54-8a52-d1d3deac1f29 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:52:52.706284 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cf9df3d9-6e54-47c4-afbb-ecf1863f14ad tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '.version_select at 0x7fc704daf550>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:52.726494 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cf9df3d9-6e54-47c4-afbb-ecf1863f14ad tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-510240058" status: 202 len: 0 microversion: 2.1 time: 0.024322 Aug 12 06:52:52.727116 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 309/605] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Aug 12 06:52:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-510240058 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:52:53.389609 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:53.390178 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] [instance: 7670ae99-2d30-43e4-96ee-381e4325ac3e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:53.396471 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:53.397155 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:53.397332 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:53.398104 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:53.398543 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:53.398937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:53.414383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] HTTP exception thrown: Instance 7670ae99-2d30-43e4-96ee-381e4325ac3e could not be found. Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Request method failure captured: Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e HTTP/1.1 Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fhJEK7WzTIPNkLrKg9IfFrBNK30M8xUXqV_AkQmkxsgk3YlAqe4vexE3LlXGBr3YAM5hRvIHtnidwZe7AZAreeVd1ZEQZk9nsdPTjq120rZUOfsSkqM00TGCTKnevu9jIJ0KNf77Jgxlnf4EWumrqLsLBVHmcwhc2rkUbUB-dxH-xA Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 7de24610a31e4f65908ac9f4ca56cbae Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1936047152 Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:52:53.416300 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7de24610a31e4f65908ac9f4ca56cbae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7de24610a31e4f65908ac9f4ca56cbae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7de24610a31e4f65908ac9f4ca56cbae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7de24610a31e4f65908ac9f4ca56cbae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesSnapshotTestJSON-1936047152 Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 7de24610a31e4f65908ac9f4ca56cbae Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1936047152 Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesSnapshotTestJSON-1936047152-project Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: c84dd7d7aec747b482cadf308411ea61 Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesSnapshotTestJSON-1936047152-project Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 7670ae99-2d30-43e4-96ee-381e4325ac3e could not be found. Aug 12 06:52:53.418050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '7670ae99-2d30-43e4-96ee-381e4325ac3e'} Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7670ae99-2d30-43e4-96ee-381e4325ac3e could not be found. Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:52:53.418959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7670ae99-2d30-43e4-96ee-381e4325ac3e could not be found. Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7670ae99-2d30-43e4-96ee-381e4325ac3e could not be found. Aug 12 06:52:53.420407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:52:53.421691 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] Returning 404 to user: Instance 7670ae99-2d30-43e4-96ee-381e4325ac3e could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:52:53.421691 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-258f57f3-d9b6-472c-8a8b-95e0176fa35b tempest-VolumesSnapshotTestJSON-1936047152 tempest-VolumesSnapshotTestJSON-1936047152-project] 10.222.0.20 "GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e" status: 404 len: 111 microversion: 2.1 time: 0.031966 Aug 12 06:52:53.421691 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 297/606] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:53 2022] GET /compute/v2.1/servers/7670ae99-2d30-43e4-96ee-381e4325ac3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:52:55.704405 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-40af8c14-b491-4425-8493-630b8a1ec9b7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:55.705049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-40af8c14-b491-4425-8493-630b8a1ec9b7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:55.713416 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40af8c14-b491-4425-8493-630b8a1ec9b7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:55.713907 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40af8c14-b491-4425-8493-630b8a1ec9b7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:55.714344 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40af8c14-b491-4425-8493-630b8a1ec9b7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:55.715068 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40af8c14-b491-4425-8493-630b8a1ec9b7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:55.715529 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40af8c14-b491-4425-8493-630b8a1ec9b7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:55.715951 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40af8c14-b491-4425-8493-630b8a1ec9b7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:55.741903 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-40af8c14-b491-4425-8493-630b8a1ec9b7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:52:55.822500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-40af8c14-b491-4425-8493-630b8a1ec9b7 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 204 len: 0 microversion: 2.1 time: 0.125131 Aug 12 06:52:55.823021 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 310/607] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:52:55 2022] DELETE /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:52:55.833253 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b6faafb1-78b2-4f4a-8a56-aa036b98774c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:55.833848 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b6faafb1-78b2-4f4a-8a56-aa036b98774c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:55.841091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6faafb1-78b2-4f4a-8a56-aa036b98774c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:55.841593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6faafb1-78b2-4f4a-8a56-aa036b98774c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:55.842015 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6faafb1-78b2-4f4a-8a56-aa036b98774c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:55.842688 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6faafb1-78b2-4f4a-8a56-aa036b98774c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:55.843171 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6faafb1-78b2-4f4a-8a56-aa036b98774c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:55.843584 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6faafb1-78b2-4f4a-8a56-aa036b98774c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:55.976051 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b6faafb1-78b2-4f4a-8a56-aa036b98774c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:55.983711 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b6faafb1-78b2-4f4a-8a56-aa036b98774c tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1507 microversion: 2.1 time: 0.156139 Aug 12 06:52:55.984267 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 298/608] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:55 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:57.008308 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f5a21c0c-c67a-4a7e-aebf-c81399431626 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:57.009015 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f5a21c0c-c67a-4a7e-aebf-c81399431626 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:57.015861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a21c0c-c67a-4a7e-aebf-c81399431626 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:57.016344 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a21c0c-c67a-4a7e-aebf-c81399431626 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:57.016775 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a21c0c-c67a-4a7e-aebf-c81399431626 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:57.017449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a21c0c-c67a-4a7e-aebf-c81399431626 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:57.017872 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a21c0c-c67a-4a7e-aebf-c81399431626 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:57.018310 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a21c0c-c67a-4a7e-aebf-c81399431626 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:57.154800 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f5a21c0c-c67a-4a7e-aebf-c81399431626 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:57.162873 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f5a21c0c-c67a-4a7e-aebf-c81399431626 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1507 microversion: 2.1 time: 0.160725 Aug 12 06:52:57.163449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 311/609] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:57 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:58.183209 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a36f3041-4a91-4513-b234-e88a1226f930 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:58.183814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a36f3041-4a91-4513-b234-e88a1226f930 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:58.190100 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36f3041-4a91-4513-b234-e88a1226f930 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:58.190573 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36f3041-4a91-4513-b234-e88a1226f930 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:58.191015 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36f3041-4a91-4513-b234-e88a1226f930 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:58.191911 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36f3041-4a91-4513-b234-e88a1226f930 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:58.192361 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36f3041-4a91-4513-b234-e88a1226f930 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:58.192776 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36f3041-4a91-4513-b234-e88a1226f930 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:58.333529 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a36f3041-4a91-4513-b234-e88a1226f930 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:58.341807 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a36f3041-4a91-4513-b234-e88a1226f930 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1507 microversion: 2.1 time: 0.162664 Aug 12 06:52:58.343318 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 299/610] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:58 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:52:59.366308 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9a058d7c-0ef3-456c-a212-d34ff4b1243b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:52:59.367067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9a058d7c-0ef3-456c-a212-d34ff4b1243b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:52:59.374035 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a058d7c-0ef3-456c-a212-d34ff4b1243b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:59.374518 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a058d7c-0ef3-456c-a212-d34ff4b1243b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:59.374938 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a058d7c-0ef3-456c-a212-d34ff4b1243b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:59.375670 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a058d7c-0ef3-456c-a212-d34ff4b1243b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:52:59.376109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a058d7c-0ef3-456c-a212-d34ff4b1243b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:52:59.376531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a058d7c-0ef3-456c-a212-d34ff4b1243b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:52:59.507537 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9a058d7c-0ef3-456c-a212-d34ff4b1243b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:52:59.515979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9a058d7c-0ef3-456c-a212-d34ff4b1243b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1507 microversion: 2.1 time: 0.155920 Aug 12 06:52:59.516617 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 312/611] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:52:59 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:00.540999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-feaa9dcc-940d-474f-ab75-3b272f717e27 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:00.541601 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-feaa9dcc-940d-474f-ab75-3b272f717e27 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:00.548477 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-feaa9dcc-940d-474f-ab75-3b272f717e27 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:00.548954 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-feaa9dcc-940d-474f-ab75-3b272f717e27 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:00.549385 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-feaa9dcc-940d-474f-ab75-3b272f717e27 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:00.550070 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-feaa9dcc-940d-474f-ab75-3b272f717e27 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:00.550523 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-feaa9dcc-940d-474f-ab75-3b272f717e27 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:00.550941 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-feaa9dcc-940d-474f-ab75-3b272f717e27 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:00.553611 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:00.692798 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-feaa9dcc-940d-474f-ab75-3b272f717e27 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:00.700480 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-feaa9dcc-940d-474f-ab75-3b272f717e27 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1507 microversion: 2.1 time: 0.164493 Aug 12 06:53:00.701027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 300/612] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:00 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:01.455464 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-bb0f9ae7-4e76-4839-8f74-8b76fdb81af5 req-bf59120c-d157-45a9-bae9-c66f9b878845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a023b3c-3e26-4379-b327-e5d86cbf2cae", "name": "network-vif-deleted", "tag": "6068429d-1e1c-4e95-a5ef-a47d18e418da"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:01.465595 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bb0f9ae7-4e76-4839-8f74-8b76fdb81af5 req-bf59120c-d157-45a9-bae9-c66f9b878845 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:01.466073 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bb0f9ae7-4e76-4839-8f74-8b76fdb81af5 req-bf59120c-d157-45a9-bae9-c66f9b878845 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:01.466564 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bb0f9ae7-4e76-4839-8f74-8b76fdb81af5 req-bf59120c-d157-45a9-bae9-c66f9b878845 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:01.482464 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-bb0f9ae7-4e76-4839-8f74-8b76fdb81af5 req-bf59120c-d157-45a9-bae9-c66f9b878845 service nova] Creating event network-vif-deleted:6068429d-1e1c-4e95-a5ef-a47d18e418da for instance 6a023b3c-3e26-4379-b327-e5d86cbf2cae on hv-cinder-84457 Aug 12 06:53:01.488429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-bb0f9ae7-4e76-4839-8f74-8b76fdb81af5 req-bf59120c-d157-45a9-bae9-c66f9b878845 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037053 Aug 12 06:53:01.489052 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 313/613] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:01.724123 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:01.725227 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:01.735938 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:01.736689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:01.737385 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:01.738410 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:01.739138 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:01.739752 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:01.773569 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:01.774072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:01.774502 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:01.775312 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lazy-loading 'fault' on Instance uuid 6a023b3c-3e26-4379-b327-e5d86cbf2cae {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:53:01.816222 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:01.823945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ecff418a-b524-4db3-b80a-d110b46e619d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 200 len: 1312 microversion: 2.1 time: 0.105798 Aug 12 06:53:01.824516 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 301/614] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:01 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:02.849728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:02.850789 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 6a023b3c-3e26-4379-b327-e5d86cbf2cae] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:02.857880 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:02.858351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:02.858778 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:02.859491 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:02.859938 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:02.860352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:02.875976 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] HTTP exception thrown: Instance 6a023b3c-3e26-4379-b327-e5d86cbf2cae could not be found. Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Request method failure captured: Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae HTTP/1.1 Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9feYq1WRxO1Mn164rhUCBzm3LFDxqEbHN0rZaCFppVUvY401Qo_9blAqxE1jSwnwng7ImaGb5PIbVbYQeOFbAubwTc9U1tEAi7xvUnwMVElhSMnvIl7Uh5962LmQALoPj8xHxamxpdP9xZrB6QoQdnWuhnf8Qeu0j7Yg5UC9bC_VafY Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 9871a1ac34bd4164bd662499cf299cbe Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:53:02.877590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9871a1ac34bd4164bd662499cf299cbe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 9871a1ac34bd4164bd662499cf299cbe Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-ServerRescueNegativeTestJSON-1861263750-project Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: cf53f022a26d48b3aa70cea4f5fbc1c3 Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1861263750-project Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 6a023b3c-3e26-4379-b327-e5d86cbf2cae could not be found. Aug 12 06:53:02.879090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '6a023b3c-3e26-4379-b327-e5d86cbf2cae'} Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a023b3c-3e26-4379-b327-e5d86cbf2cae could not be found. Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:53:02.879847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a023b3c-3e26-4379-b327-e5d86cbf2cae could not be found. Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a023b3c-3e26-4379-b327-e5d86cbf2cae could not be found. Aug 12 06:53:02.881049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:02.882317 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Returning 404 to user: Instance 6a023b3c-3e26-4379-b327-e5d86cbf2cae could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:53:02.882317 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-14917df1-c8d3-4594-a37a-9f2966e12635 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae" status: 404 len: 111 microversion: 2.1 time: 0.036330 Aug 12 06:53:02.882317 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 314/615] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:02 2022] GET /compute/v2.1/servers/6a023b3c-3e26-4379-b327-e5d86cbf2cae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:53:02.887664 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ce9b1db1-f64c-49c1-8a07-fb197ceb0f21 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:02.888162 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ce9b1db1-f64c-49c1-8a07-fb197ceb0f21 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:02.895297 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce9b1db1-f64c-49c1-8a07-fb197ceb0f21 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:02.895776 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce9b1db1-f64c-49c1-8a07-fb197ceb0f21 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:02.896210 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce9b1db1-f64c-49c1-8a07-fb197ceb0f21 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:02.896892 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce9b1db1-f64c-49c1-8a07-fb197ceb0f21 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:02.897344 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce9b1db1-f64c-49c1-8a07-fb197ceb0f21 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:02.897784 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce9b1db1-f64c-49c1-8a07-fb197ceb0f21 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:02.923127 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ce9b1db1-f64c-49c1-8a07-fb197ceb0f21 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:53:03.008702 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ce9b1db1-f64c-49c1-8a07-fb197ceb0f21 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "DELETE /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 204 len: 0 microversion: 2.1 time: 0.124532 Aug 12 06:53:03.009399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 302/616] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:53:02 2022] DELETE /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:53:03.017983 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e1ad0289-2f89-4b2e-b483-5dab7b8e207d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:03.018568 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e1ad0289-2f89-4b2e-b483-5dab7b8e207d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:03.026055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1ad0289-2f89-4b2e-b483-5dab7b8e207d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:03.026574 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1ad0289-2f89-4b2e-b483-5dab7b8e207d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:03.027005 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1ad0289-2f89-4b2e-b483-5dab7b8e207d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:03.027708 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1ad0289-2f89-4b2e-b483-5dab7b8e207d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:03.028185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1ad0289-2f89-4b2e-b483-5dab7b8e207d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:03.028758 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1ad0289-2f89-4b2e-b483-5dab7b8e207d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:03.170312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e1ad0289-2f89-4b2e-b483-5dab7b8e207d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:03.178647 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e1ad0289-2f89-4b2e-b483-5dab7b8e207d tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.164494 Aug 12 06:53:03.179358 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 315/617] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:03 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:03.561780 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-df74cce4-46d2-480f-831c-afcc3ba1f351 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:03.562353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-df74cce4-46d2-480f-831c-afcc3ba1f351 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:03.568368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df74cce4-46d2-480f-831c-afcc3ba1f351 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:03.568868 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df74cce4-46d2-480f-831c-afcc3ba1f351 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:03.569365 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df74cce4-46d2-480f-831c-afcc3ba1f351 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:03.570055 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df74cce4-46d2-480f-831c-afcc3ba1f351 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:03.570499 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df74cce4-46d2-480f-831c-afcc3ba1f351 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:03.570906 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df74cce4-46d2-480f-831c-afcc3ba1f351 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:03.594909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-df74cce4-46d2-480f-831c-afcc3ba1f351 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/ips" status: 200 len: 150 microversion: 2.1 time: 0.091330 Aug 12 06:53:03.595516 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 303/618] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 06:53:03 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:04.200051 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-40264f5d-8672-4c92-bb1e-c6828f1e4ce1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:04.200648 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-40264f5d-8672-4c92-bb1e-c6828f1e4ce1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:04.207465 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40264f5d-8672-4c92-bb1e-c6828f1e4ce1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:04.207947 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40264f5d-8672-4c92-bb1e-c6828f1e4ce1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:04.208366 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40264f5d-8672-4c92-bb1e-c6828f1e4ce1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:04.209041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40264f5d-8672-4c92-bb1e-c6828f1e4ce1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:04.209487 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40264f5d-8672-4c92-bb1e-c6828f1e4ce1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:04.209900 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40264f5d-8672-4c92-bb1e-c6828f1e4ce1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:04.346207 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-40264f5d-8672-4c92-bb1e-c6828f1e4ce1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:04.354016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-40264f5d-8672-4c92-bb1e-c6828f1e4ce1 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.157764 Aug 12 06:53:04.354588 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 316/619] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:04 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:05.377246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-693bce34-a8f1-4167-aa7f-1555748ef090 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:05.377937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-693bce34-a8f1-4167-aa7f-1555748ef090 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:05.384809 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693bce34-a8f1-4167-aa7f-1555748ef090 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:05.385281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693bce34-a8f1-4167-aa7f-1555748ef090 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:05.385708 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693bce34-a8f1-4167-aa7f-1555748ef090 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:05.386387 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693bce34-a8f1-4167-aa7f-1555748ef090 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:05.386839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693bce34-a8f1-4167-aa7f-1555748ef090 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:05.387279 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693bce34-a8f1-4167-aa7f-1555748ef090 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:05.529430 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-693bce34-a8f1-4167-aa7f-1555748ef090 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:05.538308 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-693bce34-a8f1-4167-aa7f-1555748ef090 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.165500 Aug 12 06:53:05.538987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 304/620] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:05 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:05.998643 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6b119dc9-1170-4d26-9cc9-12b56a541f55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4f92c76-94f2-4e02-ac91-d56b14eb2a6b"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:06.001091 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6b119dc9-1170-4d26-9cc9-12b56a541f55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:06.007717 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b119dc9-1170-4d26-9cc9-12b56a541f55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:06.008192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b119dc9-1170-4d26-9cc9-12b56a541f55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:06.008626 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b119dc9-1170-4d26-9cc9-12b56a541f55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:06.009365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b119dc9-1170-4d26-9cc9-12b56a541f55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:06.009812 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b119dc9-1170-4d26-9cc9-12b56a541f55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:06.010230 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b119dc9-1170-4d26-9cc9-12b56a541f55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:06.559672 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e6b9b6a7-32c1-4d29-9481-9bdb7115aa6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:06.560122 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e6b9b6a7-32c1-4d29-9481-9bdb7115aa6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:06.567044 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a7-32c1-4d29-9481-9bdb7115aa6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:06.567722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a7-32c1-4d29-9481-9bdb7115aa6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:06.568316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a7-32c1-4d29-9481-9bdb7115aa6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:06.569010 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a7-32c1-4d29-9481-9bdb7115aa6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:06.569654 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a7-32c1-4d29-9481-9bdb7115aa6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:06.570080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6b9b6a7-32c1-4d29-9481-9bdb7115aa6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:06.705436 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e6b9b6a7-32c1-4d29-9481-9bdb7115aa6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:06.713144 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e6b9b6a7-32c1-4d29-9481-9bdb7115aa6b tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.157508 Aug 12 06:53:06.713708 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 305/621] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:06 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:53:07.733692 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-30533ba9-2449-432b-accc-36138c24b7e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:07.734301 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-30533ba9-2449-432b-accc-36138c24b7e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:07.740859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30533ba9-2449-432b-accc-36138c24b7e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:07.741317 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30533ba9-2449-432b-accc-36138c24b7e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:07.741748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30533ba9-2449-432b-accc-36138c24b7e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:07.742442 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30533ba9-2449-432b-accc-36138c24b7e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:07.742893 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30533ba9-2449-432b-accc-36138c24b7e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:07.743339 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30533ba9-2449-432b-accc-36138c24b7e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:07.874763 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-30533ba9-2449-432b-accc-36138c24b7e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:07.885655 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-30533ba9-2449-432b-accc-36138c24b7e0 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.155510 Aug 12 06:53:07.886422 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 306/622] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:07 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:08.670891 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:08.689487 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6b119dc9-1170-4d26-9cc9-12b56a541f55 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.694730 Aug 12 06:53:08.690091 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 317/623] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:53:05 2022] POST /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments => generated 194 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:08.914168 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4249ebfc-4fcb-4828-86c3-25e0079c4ab2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:08.916221 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4249ebfc-4fcb-4828-86c3-25e0079c4ab2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:08.925011 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4249ebfc-4fcb-4828-86c3-25e0079c4ab2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:08.925669 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4249ebfc-4fcb-4828-86c3-25e0079c4ab2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:08.926174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4249ebfc-4fcb-4828-86c3-25e0079c4ab2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:08.927447 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4249ebfc-4fcb-4828-86c3-25e0079c4ab2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:08.928234 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4249ebfc-4fcb-4828-86c3-25e0079c4ab2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:08.928801 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4249ebfc-4fcb-4828-86c3-25e0079c4ab2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:09.084576 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4249ebfc-4fcb-4828-86c3-25e0079c4ab2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:09.093640 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4249ebfc-4fcb-4828-86c3-25e0079c4ab2 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1521 microversion: 2.1 time: 0.184274 Aug 12 06:53:09.094214 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 307/624] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:08 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:09.605419 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-c3ccfde7-3c9c-4255-90fd-11d4fc362185 req-b5192076-f730-49dd-8087-a07184259db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e", "name": "network-vif-deleted", "tag": "3488a7ce-3db5-49eb-97e2-358274ff1714"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:09.615203 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c3ccfde7-3c9c-4255-90fd-11d4fc362185 req-b5192076-f730-49dd-8087-a07184259db2 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:09.615604 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c3ccfde7-3c9c-4255-90fd-11d4fc362185 req-b5192076-f730-49dd-8087-a07184259db2 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:09.616023 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c3ccfde7-3c9c-4255-90fd-11d4fc362185 req-b5192076-f730-49dd-8087-a07184259db2 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:09.627315 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-c3ccfde7-3c9c-4255-90fd-11d4fc362185 req-b5192076-f730-49dd-8087-a07184259db2 service nova] Creating event network-vif-deleted:3488a7ce-3db5-49eb-97e2-358274ff1714 for instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e on hv-cinder-84457 Aug 12 06:53:09.632111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-c3ccfde7-3c9c-4255-90fd-11d4fc362185 req-b5192076-f730-49dd-8087-a07184259db2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031372 Aug 12 06:53:09.632786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 318/625] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:10.116582 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:10.116582 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:10.122184 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:10.122632 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:10.123112 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:10.123797 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:10.124250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:10.124664 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:10.156099 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:10.156339 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:10.156765 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:10.157203 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lazy-loading 'fault' on Instance uuid 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:53:10.205466 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf53f022a26d48b3aa70cea4f5fbc1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9871a1ac34bd4164bd662499cf299cbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:10.212704 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3951091d-963a-46c4-ada6-9ab171ef1e91 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 200 len: 1312 microversion: 2.1 time: 0.101385 Aug 12 06:53:10.213452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 308/626] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:10 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:11.234265 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:11.234938 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] [instance: 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:11.241651 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:11.242138 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:11.242563 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:11.243281 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:11.243728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:11.244143 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:11.257585 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] HTTP exception thrown: Instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e could not be found. Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Request method failure captured: Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e HTTP/1.1 Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9feYq1WRxO1Mn164rhUCBzm3LFDxqEbHN0rZaCFppVUvY401Qo_9blAqxE1jSwnwng7ImaGb5PIbVbYQeOFbAubwTc9U1tEAi7xvUnwMVElhSMnvIl7Uh5962LmQALoPj8xHxamxpdP9xZrB6QoQdnWuhnf8Qeu0j7Yg5UC9bC_VafY Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 9871a1ac34bd4164bd662499cf299cbe Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:53:11.259865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9871a1ac34bd4164bd662499cf299cbe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9871a1ac34bd4164bd662499cf299cbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 9871a1ac34bd4164bd662499cf299cbe Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1861263750 Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-ServerRescueNegativeTestJSON-1861263750-project Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: cf53f022a26d48b3aa70cea4f5fbc1c3 Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1861263750-project Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e could not be found. Aug 12 06:53:11.261448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e'} Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e could not be found. Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:53:11.262467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e could not be found. Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e could not be found. Aug 12 06:53:11.264092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:11.265479 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] Returning 404 to user: Instance 408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:53:11.265479 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e7cbfafa-dad5-4459-9446-98c8cb3e9015 tempest-ServerRescueNegativeTestJSON-1861263750 tempest-ServerRescueNegativeTestJSON-1861263750-project] 10.222.0.20 "GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e" status: 404 len: 111 microversion: 2.1 time: 0.031649 Aug 12 06:53:11.265479 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 319/627] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:11 2022] GET /compute/v2.1/servers/408b1ec7-cfe9-4d57-9317-b3c32ebd7a5e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:53:13.619192 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b888c60d-12e1-45ad-99b8-886d95a3e75e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:13.621667 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b888c60d-12e1-45ad-99b8-886d95a3e75e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:13.632152 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:13.634026 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b888c60d-12e1-45ad-99b8-886d95a3e75e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:13.634631 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b888c60d-12e1-45ad-99b8-886d95a3e75e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:13.635156 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b888c60d-12e1-45ad-99b8-886d95a3e75e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:13.636044 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b888c60d-12e1-45ad-99b8-886d95a3e75e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:13.636778 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b888c60d-12e1-45ad-99b8-886d95a3e75e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:13.637714 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b888c60d-12e1-45ad-99b8-886d95a3e75e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:13.701603 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b888c60d-12e1-45ad-99b8-886d95a3e75e tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086507 Aug 12 06:53:13.703094 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 309/628] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:53:13 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 06:53:13.782742 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d475b3e2-4454-48d4-b8e0-3c2a140b273a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:13.783271 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d475b3e2-4454-48d4-b8e0-3c2a140b273a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:13.789975 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d475b3e2-4454-48d4-b8e0-3c2a140b273a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:13.790452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d475b3e2-4454-48d4-b8e0-3c2a140b273a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:13.790878 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d475b3e2-4454-48d4-b8e0-3c2a140b273a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:13.791590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d475b3e2-4454-48d4-b8e0-3c2a140b273a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:13.792035 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d475b3e2-4454-48d4-b8e0-3c2a140b273a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:13.792452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d475b3e2-4454-48d4-b8e0-3c2a140b273a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:13.817954 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d475b3e2-4454-48d4-b8e0-3c2a140b273a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:53:13.919452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d475b3e2-4454-48d4-b8e0-3c2a140b273a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 204 len: 0 microversion: 2.1 time: 0.140074 Aug 12 06:53:13.920463 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 320/629] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:53:13 2022] DELETE /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:53:13.929256 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-238b48d1-f6df-4572-bf86-727d0e12fad4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:13.929796 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-238b48d1-f6df-4572-bf86-727d0e12fad4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:13.936697 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-238b48d1-f6df-4572-bf86-727d0e12fad4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:13.937230 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-238b48d1-f6df-4572-bf86-727d0e12fad4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:13.937655 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-238b48d1-f6df-4572-bf86-727d0e12fad4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:13.938352 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-238b48d1-f6df-4572-bf86-727d0e12fad4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:13.938802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-238b48d1-f6df-4572-bf86-727d0e12fad4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:13.939449 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-238b48d1-f6df-4572-bf86-727d0e12fad4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:14.160307 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-238b48d1-f6df-4572-bf86-727d0e12fad4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:14.168730 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-238b48d1-f6df-4572-bf86-727d0e12fad4 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1672 microversion: 2.1 time: 0.243264 Aug 12 06:53:14.169307 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 310/630] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:13 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1672 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:15.190320 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c7e3b6be-4132-436b-810d-238715222d98 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:15.191025 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c7e3b6be-4132-436b-810d-238715222d98 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:15.197501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e3b6be-4132-436b-810d-238715222d98 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:15.197978 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e3b6be-4132-436b-810d-238715222d98 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:15.198403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e3b6be-4132-436b-810d-238715222d98 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:15.199146 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e3b6be-4132-436b-810d-238715222d98 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:15.199615 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e3b6be-4132-436b-810d-238715222d98 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:15.200133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e3b6be-4132-436b-810d-238715222d98 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:15.353633 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c7e3b6be-4132-436b-810d-238715222d98 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:15.361772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c7e3b6be-4132-436b-810d-238715222d98 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1672 microversion: 2.1 time: 0.175547 Aug 12 06:53:15.362416 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 321/631] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:15 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:16.384067 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fd8266d4-e860-43fe-ab5e-7f446efc09a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:16.384623 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fd8266d4-e860-43fe-ab5e-7f446efc09a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:16.396392 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd8266d4-e860-43fe-ab5e-7f446efc09a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:16.396868 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd8266d4-e860-43fe-ab5e-7f446efc09a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:16.397777 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd8266d4-e860-43fe-ab5e-7f446efc09a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:16.398509 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd8266d4-e860-43fe-ab5e-7f446efc09a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:16.398963 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd8266d4-e860-43fe-ab5e-7f446efc09a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:16.399407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd8266d4-e860-43fe-ab5e-7f446efc09a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:16.707163 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fd8266d4-e860-43fe-ab5e-7f446efc09a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:16.717055 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fd8266d4-e860-43fe-ab5e-7f446efc09a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1672 microversion: 2.1 time: 0.336658 Aug 12 06:53:16.718380 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 311/632] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:16 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1672 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:17.403708 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4f92c76-94f2-4e02-ac91-d56b14eb2a6b"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:17.406073 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:17.409620 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:17.413489 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:17.415415 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:17.415861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:17.416578 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:17.417249 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:17.418074 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:17.534109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Invalid volume: volume f4f92c76-94f2-4e02-ac91-d56b14eb2a6b is already attached to instances: 337150f7-22b7-4d35-9da2-df74b549b5b2 Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: POST /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments HTTP/1.1 Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 74 Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:53:17.537729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {"volumeAttachment": {"volumeId": "f4f92c76-94f2-4e02-ac91-d56b14eb2a6b"}} Aug 12 06:53:17.539053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Invalid volume: volume f4f92c76-94f2-4e02-ac91-d56b14eb2a6b is already attached to instances: 337150f7-22b7-4d35-9da2-df74b549b5b2 Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'server_id': '337150f7-22b7-4d35-9da2-df74b549b5b2', 'body': {'volumeAttachment': {'volumeId': 'f4f92c76-94f2-4e02-ac91-d56b14eb2a6b'}}} Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f4f92c76-94f2-4e02-ac91-d56b14eb2a6b is already attached to instances: 337150f7-22b7-4d35-9da2-df74b549b5b2 Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:17.540225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f4f92c76-94f2-4e02-ac91-d56b14eb2a6b is already attached to instances: 337150f7-22b7-4d35-9da2-df74b549b5b2 Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:17.541458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:53:17.543324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:53:17.543324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:53:17.543324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:53:17.543324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f4f92c76-94f2-4e02-ac91-d56b14eb2a6b is already attached to instances: 337150f7-22b7-4d35-9da2-df74b549b5b2 Aug 12 06:53:17.543324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:17.543324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 400 to user: Invalid volume: volume f4f92c76-94f2-4e02-ac91-d56b14eb2a6b is already attached to instances: 337150f7-22b7-4d35-9da2-df74b549b5b2 {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:53:17.543324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-14b46a28-a6ef-45a2-959b-8f5494c70749 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.139605 Aug 12 06:53:17.543324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 322/633] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:53:17 2022] POST /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 06:53:17.639855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f630f518-ad53-4d5a-ac1f-b5eae51c5164 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:17.649764 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f630f518-ad53-4d5a-ac1f-b5eae51c5164 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:17.671905 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f630f518-ad53-4d5a-ac1f-b5eae51c5164 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:17.672748 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f630f518-ad53-4d5a-ac1f-b5eae51c5164 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:17.673392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f630f518-ad53-4d5a-ac1f-b5eae51c5164 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:17.675125 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f630f518-ad53-4d5a-ac1f-b5eae51c5164 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:17.675882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f630f518-ad53-4d5a-ac1f-b5eae51c5164 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:17.676675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f630f518-ad53-4d5a-ac1f-b5eae51c5164 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:17.815160 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-f630f518-ad53-4d5a-ac1f-b5eae51c5164 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lazy-loading 'services' on Instance uuid 337150f7-22b7-4d35-9da2-df74b549b5b2 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:53:17.903629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-dc4d71ae-6a96-4675-9f7f-cf7d58a37eae req-b423feda-519d-4741-a764-7780d560bbbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6cd9b2-0e48-4ace-96c2-ba691c366ae1", "name": "network-vif-deleted", "tag": "3e7b26bb-9495-4cbe-a8c3-ab4dc50cc862"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:17.922933 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-dc4d71ae-6a96-4675-9f7f-cf7d58a37eae req-b423feda-519d-4741-a764-7780d560bbbd service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:17.923433 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-dc4d71ae-6a96-4675-9f7f-cf7d58a37eae req-b423feda-519d-4741-a764-7780d560bbbd service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:17.923863 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-dc4d71ae-6a96-4675-9f7f-cf7d58a37eae req-b423feda-519d-4741-a764-7780d560bbbd service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:17.952423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-dc4d71ae-6a96-4675-9f7f-cf7d58a37eae req-b423feda-519d-4741-a764-7780d560bbbd service nova] Creating event network-vif-deleted:3e7b26bb-9495-4cbe-a8c3-ab4dc50cc862 for instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 on hv-cinder-84457 Aug 12 06:53:17.972564 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-dc4d71ae-6a96-4675-9f7f-cf7d58a37eae req-b423feda-519d-4741-a764-7780d560bbbd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.364447 Aug 12 06:53:17.975490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f630f518-ad53-4d5a-ac1f-b5eae51c5164 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments/f4f92c76-94f2-4e02-ac91-d56b14eb2a6b" status: 202 len: 0 microversion: 2.1 time: 0.343162 Aug 12 06:53:17.980191 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 323/634] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:53:17 2022] DELETE /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments/f4f92c76-94f2-4e02-ac91-d56b14eb2a6b => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:53:17.986241 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:17.986950 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:17.990581 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 312/635] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:17.997190 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-deb4caaa-f17a-4c17-a72b-3d8d0633e144 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:17.999824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-deb4caaa-f17a-4c17-a72b-3d8d0633e144 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:18.006661 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:18.007846 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:18.010673 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:18.011516 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:18.012120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:18.013880 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:18.015996 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-deb4caaa-f17a-4c17-a72b-3d8d0633e144 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:18.016567 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-deb4caaa-f17a-4c17-a72b-3d8d0633e144 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:18.017273 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-deb4caaa-f17a-4c17-a72b-3d8d0633e144 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:18.021264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-deb4caaa-f17a-4c17-a72b-3d8d0633e144 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:18.021965 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-deb4caaa-f17a-4c17-a72b-3d8d0633e144 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:18.022626 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-deb4caaa-f17a-4c17-a72b-3d8d0633e144 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:18.053083 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:18.053926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:18.054592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:18.055803 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lazy-loading 'fault' on Instance uuid 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:53:18.079562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-deb4caaa-f17a-4c17-a72b-3d8d0633e144 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087353 Aug 12 06:53:18.082650 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 313/636] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:53:17 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:18.106633 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:18.120311 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-93c8041f-3344-4ac4-a86b-e4f188f20760 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 200 len: 1327 microversion: 2.1 time: 0.138046 Aug 12 06:53:18.120932 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 324/637] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:17 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 1327 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:19.097078 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d30f5e81-cc55-4444-becf-e99d70c31a51 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:19.104846 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d30f5e81-cc55-4444-becf-e99d70c31a51 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:19.115291 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30f5e81-cc55-4444-becf-e99d70c31a51 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:19.117027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30f5e81-cc55-4444-becf-e99d70c31a51 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:19.117474 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30f5e81-cc55-4444-becf-e99d70c31a51 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:19.119398 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30f5e81-cc55-4444-becf-e99d70c31a51 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:19.119874 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30f5e81-cc55-4444-becf-e99d70c31a51 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:19.120302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d30f5e81-cc55-4444-becf-e99d70c31a51 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:19.147018 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:19.148804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:19.157540 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:19.158388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:19.159137 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:19.160746 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:19.161404 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:19.162052 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:19.177081 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d30f5e81-cc55-4444-becf-e99d70c31a51 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086346 Aug 12 06:53:19.178222 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 314/638] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:53:19 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:19.179165 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] HTTP exception thrown: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Request method failure captured: Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 HTTP/1.1 Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9feiEayTqz6iUb09CgktxM0i4IgDo8G2uul27_PIYiExKCW03HqSeZxlgkNU-39g-KazDesmU0TY1ouEdvA1maJhOY5LNw8XgS9Sqcx4jbZj-IsGAyAlS3p0BpzgTSl5YeH9stnGC9CaS670DkXTPeSA0-rqZjy7mUZhJBRzU08lgdM Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:53:19.180988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_953a18a150ee420b908ea4c3665811b6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 498c574c32a341a59287de043fa0fe3f Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:53:19.182295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '8c6cd9b2-0e48-4ace-96c2-ba691c366ae1'} Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:53:19.183070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:53:19.184731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:53:19.185765 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Returning 404 to user: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:53:19.185765 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-75a42303-291c-4b9e-a80f-3eb6edcd8277 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 404 len: 111 microversion: 2.1 time: 0.042386 Aug 12 06:53:19.186663 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 325/639] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:19 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:53:19.194403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-35016905-fdbf-4044-af81-3f45cc895593 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '.version_select at 0x7fc7044eac10>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:19.221013 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-35016905-fdbf-4044-af81-3f45cc895593 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691547418" status: 202 len: 0 microversion: 2.1 time: 0.032947 Aug 12 06:53:19.221639 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 315/640] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Aug 12 06:53:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691547418 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:53:19.982370 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-acdff4c6-33a7-4832-958b-0059c4b70d46 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Action: 'create', calling method: .version_select at 0x7fc7051ed8b0>, body: {"keypair": {"name": "tempest-keypair-1956231197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG37IWoFBLr4ubQauJSbFfOuQ0HPrDccFvTlqEE+w7ORg3ehOO4R2FWwiX/NyFdL1keY6dB2IHJ/7SMF1Z3sUdaDrWV27yqCOB4PYbdbWfkRKtmNFYloRI0c1nU3piPqTw=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:20.006077 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-acdff4c6-33a7-4832-958b-0059c4b70d46 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Getting quotas for project 953a18a150ee420b908ea4c3665811b6. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:53:20.012284 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-acdff4c6-33a7-4832-958b-0059c4b70d46 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Getting quotas for user 498c574c32a341a59287de043fa0fe3f and project 953a18a150ee420b908ea4c3665811b6. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:53:20.042840 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-acdff4c6-33a7-4832-958b-0059c4b70d46 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064401 Aug 12 06:53:20.043983 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 316/641] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 06:53:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:20.203517 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-96d7f9ff-6568-4465-8aaa-1b2383615c01 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:20.208324 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-96d7f9ff-6568-4465-8aaa-1b2383615c01 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:20.231665 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96d7f9ff-6568-4465-8aaa-1b2383615c01 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:20.232458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96d7f9ff-6568-4465-8aaa-1b2383615c01 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:20.234012 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96d7f9ff-6568-4465-8aaa-1b2383615c01 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:20.234894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96d7f9ff-6568-4465-8aaa-1b2383615c01 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:20.240449 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96d7f9ff-6568-4465-8aaa-1b2383615c01 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:20.241172 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96d7f9ff-6568-4465-8aaa-1b2383615c01 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:20.274722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:20.315721 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-96d7f9ff-6568-4465-8aaa-1b2383615c01 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127156 Aug 12 06:53:20.320577 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 317/642] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:53:20 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 06:53:20.346122 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-97deba00-ae00-4810-8eda-f1b2138b1775 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:20.346669 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-97deba00-ae00-4810-8eda-f1b2138b1775 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:20.358496 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97deba00-ae00-4810-8eda-f1b2138b1775 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:20.361755 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97deba00-ae00-4810-8eda-f1b2138b1775 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:20.362203 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97deba00-ae00-4810-8eda-f1b2138b1775 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:20.365017 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97deba00-ae00-4810-8eda-f1b2138b1775 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:20.365488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97deba00-ae00-4810-8eda-f1b2138b1775 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:20.365916 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97deba00-ae00-4810-8eda-f1b2138b1775 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:20.429903 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-97deba00-ae00-4810-8eda-f1b2138b1775 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/ips" status: 200 len: 153 microversion: 2.20 time: 0.451619 Aug 12 06:53:20.432675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 326/643] 10.222.0.20 () {60 vars in 1289 bytes} [Fri Aug 12 06:53:19 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/ips => generated 153 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:53:20.450730 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-73f71384-fb3f-42cc-9607-ca94771e3c82 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:20.452600 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-73f71384-fb3f-42cc-9607-ca94771e3c82 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:20.469498 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73f71384-fb3f-42cc-9607-ca94771e3c82 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:20.470298 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73f71384-fb3f-42cc-9607-ca94771e3c82 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:20.470747 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73f71384-fb3f-42cc-9607-ca94771e3c82 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:20.474722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73f71384-fb3f-42cc-9607-ca94771e3c82 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:20.475574 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73f71384-fb3f-42cc-9607-ca94771e3c82 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:20.476711 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73f71384-fb3f-42cc-9607-ca94771e3c82 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:20.530384 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-73f71384-fb3f-42cc-9607-ca94771e3c82 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:53:20.711637 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-73f71384-fb3f-42cc-9607-ca94771e3c82 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 204 len: 0 microversion: 2.1 time: 0.267990 Aug 12 06:53:20.712932 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 318/644] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:53:20 2022] DELETE /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:53:20.721481 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f1a9d6e9-d4b9-45dd-954f-c2d40ad875bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:20.722445 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f1a9d6e9-d4b9-45dd-954f-c2d40ad875bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:20.731987 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1a9d6e9-d4b9-45dd-954f-c2d40ad875bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:20.733110 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1a9d6e9-d4b9-45dd-954f-c2d40ad875bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:20.733866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1a9d6e9-d4b9-45dd-954f-c2d40ad875bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:20.734948 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1a9d6e9-d4b9-45dd-954f-c2d40ad875bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:20.735704 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1a9d6e9-d4b9-45dd-954f-c2d40ad875bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:20.736523 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1a9d6e9-d4b9-45dd-954f-c2d40ad875bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:21.091795 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f1a9d6e9-d4b9-45dd-954f-c2d40ad875bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:21.104366 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f1a9d6e9-d4b9-45dd-954f-c2d40ad875bb tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1682 microversion: 2.1 time: 0.387012 Aug 12 06:53:21.107405 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 327/645] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:20 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1682 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:22.126788 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b663b6f9-4023-4495-9e13-b18e542ffe23 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:22.127504 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b663b6f9-4023-4495-9e13-b18e542ffe23 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:22.138737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b663b6f9-4023-4495-9e13-b18e542ffe23 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:22.140155 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b663b6f9-4023-4495-9e13-b18e542ffe23 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:22.141656 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b663b6f9-4023-4495-9e13-b18e542ffe23 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:22.143866 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b663b6f9-4023-4495-9e13-b18e542ffe23 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:22.144824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b663b6f9-4023-4495-9e13-b18e542ffe23 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:22.148343 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b663b6f9-4023-4495-9e13-b18e542ffe23 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:22.499515 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b663b6f9-4023-4495-9e13-b18e542ffe23 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:22.513481 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b663b6f9-4023-4495-9e13-b18e542ffe23 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1682 microversion: 2.1 time: 0.390803 Aug 12 06:53:22.517120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 319/646] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:22 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1682 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:22.566549 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-173055612", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de62d086-c1e5-4c9e-91ef-840123cf1c0c"}], "security_groups": [{"name": "tempest-securitygroup--1020637165"}], "key_name": "tempest-keypair-1956231197", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:22.831103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] validate_networks() for [('de62d086-c1e5-4c9e-91ef-840123cf1c0c', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:53:22.950968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3d93769f-aaaa-4b40-b7bc-85a7180a3f4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:22.951522 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3d93769f-aaaa-4b40-b7bc-85a7180a3f4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:22.963166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d93769f-aaaa-4b40-b7bc-85a7180a3f4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:22.963832 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d93769f-aaaa-4b40-b7bc-85a7180a3f4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:22.964288 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d93769f-aaaa-4b40-b7bc-85a7180a3f4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:22.965204 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d93769f-aaaa-4b40-b7bc-85a7180a3f4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:22.969975 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d93769f-aaaa-4b40-b7bc-85a7180a3f4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:22.970584 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d93769f-aaaa-4b40-b7bc-85a7180a3f4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:23.047587 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-3d93769f-aaaa-4b40-b7bc-85a7180a3f4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lazy-loading 'flavor' on Instance uuid 0893bde6-8eaf-4ca0-95bb-0c04c57e158e {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:53:23.458831 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3d93769f-aaaa-4b40-b7bc-85a7180a3f4f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "POST /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/action" status: 202 len: 0 microversion: 2.20 time: 0.511779 Aug 12 06:53:23.479240 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 320/647] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Aug 12 06:53:22 2022] POST /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:53:23.494350 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:23.496268 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:23.522630 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:23.523676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:23.524599 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:23.526216 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:23.526847 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:23.527509 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:23.942551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:23.966248 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:23.977588 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:23.979341 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2f620dee-9f25-4b13-9c2b-2870118b48af tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.496843 Aug 12 06:53:23.982446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 321/648] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:23 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:23.997183 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:23.998053 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:24.005417 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:24.006076 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:24.006689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:24.007624 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:24.012191 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:24.012812 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:24.093765 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:24.094186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:24.094686 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:24.095226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lazy-loading 'fault' on Instance uuid 337150f7-22b7-4d35-9da2-df74b549b5b2 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:53:24.208297 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:24.226634 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2ea260b3-33a4-4b8d-8d27-2540fae33737 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 200 len: 1332 microversion: 2.1 time: 0.236508 Aug 12 06:53:24.243420 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 322/649] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:23 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 1332 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:24.252970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-61632aef-b489-4475-922f-9a41aee6d1cf req-ab9ea396-6323-4cdb-b0d9-835573397e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337150f7-22b7-4d35-9da2-df74b549b5b2", "name": "network-vif-deleted", "tag": "0692b8e8-530a-4198-b110-0f594f201062"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:24.286301 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-61632aef-b489-4475-922f-9a41aee6d1cf req-ab9ea396-6323-4cdb-b0d9-835573397e4d service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:24.287831 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-61632aef-b489-4475-922f-9a41aee6d1cf req-ab9ea396-6323-4cdb-b0d9-835573397e4d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:24.290076 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-61632aef-b489-4475-922f-9a41aee6d1cf req-ab9ea396-6323-4cdb-b0d9-835573397e4d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:24.335427 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-61632aef-b489-4475-922f-9a41aee6d1cf req-ab9ea396-6323-4cdb-b0d9-835573397e4d service nova] Creating event network-vif-deleted:0692b8e8-530a-4198-b110-0f594f201062 for instance 337150f7-22b7-4d35-9da2-df74b549b5b2 on hv-cinder-84457 Aug 12 06:53:24.353501 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-61632aef-b489-4475-922f-9a41aee6d1cf req-ab9ea396-6323-4cdb-b0d9-835573397e4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106482 Aug 12 06:53:24.354112 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 323/650] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:24.478762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:53:24.479384 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:53:24.480167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:53:24.480934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:53:24.482305 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:53:24.518837 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:24.520693 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:24.521795 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:24.522919 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:24.524030 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:24.524649 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:24.554330 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Getting quotas for project 953a18a150ee420b908ea4c3665811b6. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:53:24.561548 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Getting quotas for user 498c574c32a341a59287de043fa0fe3f and project 953a18a150ee420b908ea4c3665811b6. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:53:24.576894 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:53:24.581580 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:53:24.658469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d1ddcfc9-ec72-424d-8973-f67124330be6 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.096270 Aug 12 06:53:24.666145 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 328/651] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:53:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 2104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:53:24.672148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-22a572cd-b5bc-4cfa-a7ed-73f9999697f2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:24.673422 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-22a572cd-b5bc-4cfa-a7ed-73f9999697f2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:24.842643 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-22a572cd-b5bc-4cfa-a7ed-73f9999697f2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:24.855422 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-22a572cd-b5bc-4cfa-a7ed-73f9999697f2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1237 microversion: 2.1 time: 0.187721 Aug 12 06:53:24.856092 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 324/652] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:24 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1237 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:25.007002 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:25.009085 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:25.027500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:25.028167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:25.029559 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:25.030554 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:25.031466 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:25.032139 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:25.252288 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:25.254756 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:25.265445 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:25.266281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:25.267622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:25.268954 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:25.271018 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:25.271785 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:25.320263 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 HTTP/1.1 Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:53:25.321937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:53:25.323302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '337150f7-22b7-4d35-9da2-df74b549b5b2'} Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:53:25.324386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:53:25.326185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:53:25.329474 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:53:25.329474 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bb0815a4-fdbe-4ae0-ad64-da06a9536fe9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 404 len: 111 microversion: 2.1 time: 0.077630 Aug 12 06:53:25.341868 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 325/653] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:25 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 06:53:25.347403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f100eab8-1d46-4a95-b777-979a75b644af tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '.version_select at 0x7fc70464c670>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:25.399799 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:25.414898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:25.420248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:25.423118 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-334c425d-176b-4bb2-8f8a-4583da7b86bf tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.421079 Aug 12 06:53:25.425124 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f100eab8-1d46-4a95-b777-979a75b644af tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595662481" status: 202 len: 0 microversion: 2.1 time: 0.079669 Aug 12 06:53:25.425750 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 326/654] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Aug 12 06:53:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595662481 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:53:25.429667 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 329/655] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:25 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:25.887588 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-87fdb1d4-4536-4b50-9250-73f531ba99bd tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:25.888857 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-87fdb1d4-4536-4b50-9250-73f531ba99bd tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:25.908035 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87fdb1d4-4536-4b50-9250-73f531ba99bd tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:25.908805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87fdb1d4-4536-4b50-9250-73f531ba99bd tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:25.909589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87fdb1d4-4536-4b50-9250-73f531ba99bd tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:25.911401 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87fdb1d4-4536-4b50-9250-73f531ba99bd tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:25.912126 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87fdb1d4-4536-4b50-9250-73f531ba99bd tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:25.912800 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87fdb1d4-4536-4b50-9250-73f531ba99bd tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:26.003589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-87fdb1d4-4536-4b50-9250-73f531ba99bd tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:26.012518 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-87fdb1d4-4536-4b50-9250-73f531ba99bd tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1289 microversion: 2.1 time: 0.135450 Aug 12 06:53:26.014479 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 327/656] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:25 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:26.462214 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:26.462813 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:26.479429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:26.480165 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:26.482678 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:26.483657 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:26.485988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:26.486671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:26.697704 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c75cad57-a23e-4f12-a7ac-a34c5c921d1c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: .version_select at 0x7fc704557430>, body: {"keypair": {"name": "tempest-keypair-1778862283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMChH1bJcF+Ruf6d9vKryatDkrDmdpLOy9ExIeJjjFTz8dSBihqZgiE27gTBcaAKdfHOgevkeiYJcFy2by92iWRwleiny4/bZKQviapVmDvx7zeg5CshbItVW3h6tOMfg=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:26.708508 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:26.721227 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:26.723448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:26.725000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fef4f734-b1a4-4877-b130-59378570545d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.268310 Aug 12 06:53:26.728336 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-c75cad57-a23e-4f12-a7ac-a34c5c921d1c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for project b89f418ef5fd41b39c0a0a36968da428. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:53:26.732987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-c75cad57-a23e-4f12-a7ac-a34c5c921d1c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for user 342ef719c63d4fbfa5a2a3943bd3b24b and project b89f418ef5fd41b39c0a0a36968da428. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:53:26.737116 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 330/657] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:26 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:26.761593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c75cad57-a23e-4f12-a7ac-a34c5c921d1c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.069530 Aug 12 06:53:26.762827 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 328/658] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 06:53:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:53:27.034181 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-75b0d23f-ef3c-446e-846c-edc297da48b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:27.035159 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-75b0d23f-ef3c-446e-846c-edc297da48b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:27.044969 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b0d23f-ef3c-446e-846c-edc297da48b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:27.051806 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b0d23f-ef3c-446e-846c-edc297da48b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:27.052909 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b0d23f-ef3c-446e-846c-edc297da48b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:27.054777 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b0d23f-ef3c-446e-846c-edc297da48b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:27.055508 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b0d23f-ef3c-446e-846c-edc297da48b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:27.056158 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b0d23f-ef3c-446e-846c-edc297da48b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:27.193442 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-75b0d23f-ef3c-446e-846c-edc297da48b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:27.211986 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-75b0d23f-ef3c-446e-846c-edc297da48b1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1295 microversion: 2.1 time: 0.175613 Aug 12 06:53:27.227458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 331/659] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:27 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1295 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:27.752876 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:27.753991 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:27.779055 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:27.781568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:27.782358 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:27.784884 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:27.786654 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:27.789363 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:28.022212 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:28.034036 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:28.036364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:28.048274 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a5d81246-223b-476f-8c96-95b410c03de0 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.292937 Aug 12 06:53:28.055654 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 329/660] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:27 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:28.234105 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0a0a6ee5-2fb2-49a2-ad13-576cfdacd32b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:28.235756 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0a0a6ee5-2fb2-49a2-ad13-576cfdacd32b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:28.250892 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a0a6ee5-2fb2-49a2-ad13-576cfdacd32b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:28.254887 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a0a6ee5-2fb2-49a2-ad13-576cfdacd32b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:28.257331 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a0a6ee5-2fb2-49a2-ad13-576cfdacd32b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:28.263095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a0a6ee5-2fb2-49a2-ad13-576cfdacd32b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:28.264420 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a0a6ee5-2fb2-49a2-ad13-576cfdacd32b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:28.266495 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a0a6ee5-2fb2-49a2-ad13-576cfdacd32b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:28.714333 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0a0a6ee5-2fb2-49a2-ad13-576cfdacd32b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:28.724850 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0a0a6ee5-2fb2-49a2-ad13-576cfdacd32b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1363 microversion: 2.1 time: 0.494642 Aug 12 06:53:28.728876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 332/661] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:28 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1363 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:29.069823 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:29.070439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:29.084846 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:29.085735 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:29.086342 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:29.089323 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:29.094283 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:29.095012 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:29.401528 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:29.417781 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:29.425965 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:29.428084 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-86f3c8eb-f8be-44d1-a4f4-9a6880712c84 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.366623 Aug 12 06:53:29.453066 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 330/662] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:29 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:29.756933 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7b0afc82-046b-4f4b-bff8-2413e402032a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:29.758557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7b0afc82-046b-4f4b-bff8-2413e402032a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:29.769392 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b0afc82-046b-4f4b-bff8-2413e402032a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:29.770345 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b0afc82-046b-4f4b-bff8-2413e402032a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:29.772936 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b0afc82-046b-4f4b-bff8-2413e402032a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:29.774393 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b0afc82-046b-4f4b-bff8-2413e402032a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:29.775487 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b0afc82-046b-4f4b-bff8-2413e402032a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:29.777394 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b0afc82-046b-4f4b-bff8-2413e402032a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:30.237960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7b0afc82-046b-4f4b-bff8-2413e402032a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:30.247901 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7b0afc82-046b-4f4b-bff8-2413e402032a tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1363 microversion: 2.1 time: 0.502573 Aug 12 06:53:30.248486 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 333/663] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:29 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1363 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:30.462238 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:30.463616 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:30.500760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:30.501606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:30.502255 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:30.503252 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:30.505716 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:30.506144 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:30.833931 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-78d16a54-d212-4fce-81c9-89c829443cf5 req-326f8d57-ff95-4529-8c08-7a503f374e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec690cd-9235-4c52-95c6-b6f74a37e813", "tag": "e7f7943f-2c08-4fad-af7b-e7c8e55bd098"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:30.846519 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-78d16a54-d212-4fce-81c9-89c829443cf5 req-326f8d57-ff95-4529-8c08-7a503f374e07 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:30.847031 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-78d16a54-d212-4fce-81c9-89c829443cf5 req-326f8d57-ff95-4529-8c08-7a503f374e07 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:30.847455 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-78d16a54-d212-4fce-81c9-89c829443cf5 req-326f8d57-ff95-4529-8c08-7a503f374e07 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:30.860336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-78d16a54-d212-4fce-81c9-89c829443cf5 req-326f8d57-ff95-4529-8c08-7a503f374e07 service nova] Creating event network-changed:e7f7943f-2c08-4fad-af7b-e7c8e55bd098 for instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 on hv-cinder-84457 Aug 12 06:53:30.868251 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-78d16a54-d212-4fce-81c9-89c829443cf5 req-326f8d57-ff95-4529-8c08-7a503f374e07 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038090 Aug 12 06:53:30.868892 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 334/664] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:53:30.876965 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-380067731", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f384a833-4d30-4845-aa83-a1cad46c6a6b"}], "security_groups": [{"name": "tempest-securitygroup--236829343"}], "key_name": "tempest-keypair-1778862283", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:31.112094 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:31.127416 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:31.129848 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:31.137880 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b48b2a20-4cb0-4d0f-a928-ed0b996e9aea tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.675229 Aug 12 06:53:31.139096 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 331/665] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:30 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:31.189150 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] validate_networks() for [('f384a833-4d30-4845-aa83-a1cad46c6a6b', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:53:31.268713 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ac54294b-a3f8-4961-9a1e-755aac042665 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:31.269835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ac54294b-a3f8-4961-9a1e-755aac042665 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:31.280657 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac54294b-a3f8-4961-9a1e-755aac042665 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:31.284308 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac54294b-a3f8-4961-9a1e-755aac042665 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:31.284873 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac54294b-a3f8-4961-9a1e-755aac042665 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:31.285605 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac54294b-a3f8-4961-9a1e-755aac042665 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:31.297780 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac54294b-a3f8-4961-9a1e-755aac042665 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:31.298446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac54294b-a3f8-4961-9a1e-755aac042665 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:31.713765 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ac54294b-a3f8-4961-9a1e-755aac042665 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:31.733896 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ac54294b-a3f8-4961-9a1e-755aac042665 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1363 microversion: 2.1 time: 0.469261 Aug 12 06:53:31.735170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 332/666] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:31 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1363 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:53:32.040934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:53:32.043838 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:53:32.044388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:53:32.044786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:53:32.045197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:53:32.057646 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:32.058569 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:32.059242 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:32.060820 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:32.061289 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:32.063855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:32.078770 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:32.097096 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for project b89f418ef5fd41b39c0a0a36968da428. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:53:32.102266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Getting quotas for user 342ef719c63d4fbfa5a2a3943bd3b24b and project b89f418ef5fd41b39c0a0a36968da428. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:53:32.116472 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:53:32.119251 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:53:32.162078 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:32.163291 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:32.173754 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:32.174606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:32.175970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:32.176931 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:32.181103 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:32.181823 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:32.197810 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8c85a6a6-f45f-4dc6-8b83-5f152166bffa tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.325544 Aug 12 06:53:32.198830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 335/667] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:53:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:53:32.216124 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e8664381-a12c-42cd-b052-6a808670852e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:32.217772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e8664381-a12c-42cd-b052-6a808670852e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:32.462904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e8664381-a12c-42cd-b052-6a808670852e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:32.473472 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e8664381-a12c-42cd-b052-6a808670852e tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1241 microversion: 2.1 time: 0.267331 Aug 12 06:53:32.478399 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 336/668] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:32 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1241 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:32.548522 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:32.557186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:32.559032 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:32.560630 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3132c285-2675-444c-94a9-f9f1b507d267 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.402650 Aug 12 06:53:32.561400 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 333/669] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:32 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:53:32.757568 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f860eae9-2734-4c23-bc07-5f19ae68198f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:32.758831 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f860eae9-2734-4c23-bc07-5f19ae68198f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:32.772808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f860eae9-2734-4c23-bc07-5f19ae68198f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:32.773766 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f860eae9-2734-4c23-bc07-5f19ae68198f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:32.774463 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f860eae9-2734-4c23-bc07-5f19ae68198f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:32.776522 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f860eae9-2734-4c23-bc07-5f19ae68198f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:32.777298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f860eae9-2734-4c23-bc07-5f19ae68198f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:32.778481 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f860eae9-2734-4c23-bc07-5f19ae68198f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:33.014542 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f860eae9-2734-4c23-bc07-5f19ae68198f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:33.029473 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f860eae9-2734-4c23-bc07-5f19ae68198f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1363 microversion: 2.1 time: 0.277552 Aug 12 06:53:33.043228 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 337/670] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:32 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:33.510572 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d5d2b316-9f00-4a09-a786-4b2002030fd8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:33.517114 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d5d2b316-9f00-4a09-a786-4b2002030fd8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:33.547286 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5d2b316-9f00-4a09-a786-4b2002030fd8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:33.549558 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5d2b316-9f00-4a09-a786-4b2002030fd8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:33.550198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5d2b316-9f00-4a09-a786-4b2002030fd8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:33.551118 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5d2b316-9f00-4a09-a786-4b2002030fd8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:33.551809 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5d2b316-9f00-4a09-a786-4b2002030fd8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:33.552436 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5d2b316-9f00-4a09-a786-4b2002030fd8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:33.587474 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:33.588537 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:33.601148 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:33.608445 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:33.610939 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:33.614445 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:33.614915 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:33.615377 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:33.617528 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:33.799125 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d5d2b316-9f00-4a09-a786-4b2002030fd8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:33.807975 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d5d2b316-9f00-4a09-a786-4b2002030fd8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1301 microversion: 2.1 time: 0.317418 Aug 12 06:53:33.815414 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 334/671] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:33 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1301 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:33.962928 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:33.972635 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:33.975436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:33.977593 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-aedc5858-ffa2-42bc-878f-9621b91c7613 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.396768 Aug 12 06:53:33.978611 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 338/672] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:33 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:53:34.050539 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-823829fb-43bd-4e3e-bfba-bd69cdadd9c2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:34.051400 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-823829fb-43bd-4e3e-bfba-bd69cdadd9c2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:34.069731 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-823829fb-43bd-4e3e-bfba-bd69cdadd9c2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:34.070648 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-823829fb-43bd-4e3e-bfba-bd69cdadd9c2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:34.071324 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-823829fb-43bd-4e3e-bfba-bd69cdadd9c2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:34.072253 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-823829fb-43bd-4e3e-bfba-bd69cdadd9c2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:34.073024 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-823829fb-43bd-4e3e-bfba-bd69cdadd9c2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:34.073679 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-823829fb-43bd-4e3e-bfba-bd69cdadd9c2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:34.519977 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-823829fb-43bd-4e3e-bfba-bd69cdadd9c2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:34.532424 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-823829fb-43bd-4e3e-bfba-bd69cdadd9c2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1363 microversion: 2.1 time: 0.486155 Aug 12 06:53:34.533385 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 335/673] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:34 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1363 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:34.838423 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-792d4427-492c-4dfe-87f1-a77acc029cbd tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:34.839180 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-792d4427-492c-4dfe-87f1-a77acc029cbd tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:34.851276 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-792d4427-492c-4dfe-87f1-a77acc029cbd tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:34.851955 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-792d4427-492c-4dfe-87f1-a77acc029cbd tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:34.852480 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-792d4427-492c-4dfe-87f1-a77acc029cbd tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:34.853304 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-792d4427-492c-4dfe-87f1-a77acc029cbd tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:34.855228 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-792d4427-492c-4dfe-87f1-a77acc029cbd tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:34.855544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-792d4427-492c-4dfe-87f1-a77acc029cbd tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:35.001856 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:35.002432 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:35.009048 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:35.009788 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:35.010370 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:35.011275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:35.012037 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:35.012597 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:35.055134 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-792d4427-492c-4dfe-87f1-a77acc029cbd tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:35.064810 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-792d4427-492c-4dfe-87f1-a77acc029cbd tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1366 microversion: 2.1 time: 0.230728 Aug 12 06:53:35.066162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 339/674] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:34 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:35.242000 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:35.252726 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:35.254527 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:35.255804 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2029b8fc-65b9-48db-8a52-59d35a054748 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.257963 Aug 12 06:53:35.256537 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 336/675] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:34 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:35.553006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-11b4a3ee-f73d-45d8-8a17-3727cfa35fff tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:35.553796 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-11b4a3ee-f73d-45d8-8a17-3727cfa35fff tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:35.566774 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11b4a3ee-f73d-45d8-8a17-3727cfa35fff tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:35.567745 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11b4a3ee-f73d-45d8-8a17-3727cfa35fff tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:35.568348 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11b4a3ee-f73d-45d8-8a17-3727cfa35fff tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:35.569235 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11b4a3ee-f73d-45d8-8a17-3727cfa35fff tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:35.569843 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11b4a3ee-f73d-45d8-8a17-3727cfa35fff tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:35.571540 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11b4a3ee-f73d-45d8-8a17-3727cfa35fff tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:35.632506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-231dca50-7f1d-4cd6-b6b3-fe09394f33df req-b1110f2a-c446-4418-bfb4-c04972203d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9145d8-3483-4e57-8350-b4b26927dff1", "tag": "9be0b6eb-1b87-4534-89f5-a3b7efc1f96d"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:35.652715 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-231dca50-7f1d-4cd6-b6b3-fe09394f33df req-b1110f2a-c446-4418-bfb4-c04972203d18 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:35.654969 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-231dca50-7f1d-4cd6-b6b3-fe09394f33df req-b1110f2a-c446-4418-bfb4-c04972203d18 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:35.655543 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-231dca50-7f1d-4cd6-b6b3-fe09394f33df req-b1110f2a-c446-4418-bfb4-c04972203d18 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:35.685576 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-231dca50-7f1d-4cd6-b6b3-fe09394f33df req-b1110f2a-c446-4418-bfb4-c04972203d18 service nova] Creating event network-changed:9be0b6eb-1b87-4534-89f5-a3b7efc1f96d for instance da9145d8-3483-4e57-8350-b4b26927dff1 on hv-cinder-84457 Aug 12 06:53:35.696899 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-231dca50-7f1d-4cd6-b6b3-fe09394f33df req-b1110f2a-c446-4418-bfb4-c04972203d18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067492 Aug 12 06:53:35.698425 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 337/676] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:35.897609 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-11b4a3ee-f73d-45d8-8a17-3727cfa35fff tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:35.909844 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-11b4a3ee-f73d-45d8-8a17-3727cfa35fff tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1363 microversion: 2.1 time: 0.360111 Aug 12 06:53:35.912576 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 340/677] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:35 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:36.090566 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6124927c-9423-4a16-8d14-8a9ebb40e56d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:36.092228 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6124927c-9423-4a16-8d14-8a9ebb40e56d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:36.116993 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6124927c-9423-4a16-8d14-8a9ebb40e56d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:36.117986 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6124927c-9423-4a16-8d14-8a9ebb40e56d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:36.120223 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6124927c-9423-4a16-8d14-8a9ebb40e56d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:36.121280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6124927c-9423-4a16-8d14-8a9ebb40e56d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:36.125120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6124927c-9423-4a16-8d14-8a9ebb40e56d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:36.126776 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6124927c-9423-4a16-8d14-8a9ebb40e56d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:36.281316 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:36.281978 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:36.295645 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:36.296488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:36.296924 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:36.297636 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:36.309870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:36.310614 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:36.520900 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6124927c-9423-4a16-8d14-8a9ebb40e56d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:36.537775 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6124927c-9423-4a16-8d14-8a9ebb40e56d tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1366 microversion: 2.1 time: 0.451659 Aug 12 06:53:36.542668 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 338/678] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:36 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:36.582940 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:36.601801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:36.604690 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:36.606555 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2f6980d2-38f0-4922-8d50-98cab897e9a9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.330423 Aug 12 06:53:36.609908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 341/679] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:36 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:36.742473 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=10 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:36.854546 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-abe6e8ef-22cc-461b-950b-8934e5c79781 req-32a29c04-d602-49a7-9451-0857168d69b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec690cd-9235-4c52-95c6-b6f74a37e813", "name": "network-vif-plugged", "status": "completed", "tag": "e7f7943f-2c08-4fad-af7b-e7c8e55bd098"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:36.881643 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-abe6e8ef-22cc-461b-950b-8934e5c79781 req-32a29c04-d602-49a7-9451-0857168d69b5 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:36.884950 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-abe6e8ef-22cc-461b-950b-8934e5c79781 req-32a29c04-d602-49a7-9451-0857168d69b5 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:36.885581 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-abe6e8ef-22cc-461b-950b-8934e5c79781 req-32a29c04-d602-49a7-9451-0857168d69b5 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:36.912489 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-abe6e8ef-22cc-461b-950b-8934e5c79781 req-32a29c04-d602-49a7-9451-0857168d69b5 service nova] Creating event network-vif-plugged:e7f7943f-2c08-4fad-af7b-e7c8e55bd098 for instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 on hv-cinder-84457 Aug 12 06:53:36.924276 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-abe6e8ef-22cc-461b-950b-8934e5c79781 req-32a29c04-d602-49a7-9451-0857168d69b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.367561 Aug 12 06:53:36.925373 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 339/680] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:36.933491 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-18fcb195-2817-4f54-9df8-21406d064f7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:36.935092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-18fcb195-2817-4f54-9df8-21406d064f7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:36.943178 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18fcb195-2817-4f54-9df8-21406d064f7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:36.944107 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18fcb195-2817-4f54-9df8-21406d064f7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:36.944697 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18fcb195-2817-4f54-9df8-21406d064f7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:36.945575 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18fcb195-2817-4f54-9df8-21406d064f7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:36.946182 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18fcb195-2817-4f54-9df8-21406d064f7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:36.946756 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18fcb195-2817-4f54-9df8-21406d064f7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:37.133633 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-18fcb195-2817-4f54-9df8-21406d064f7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:37.144716 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-18fcb195-2817-4f54-9df8-21406d064f7f tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1363 microversion: 2.1 time: 0.215274 Aug 12 06:53:37.145891 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 342/681] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:36 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:37.570929 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9a4127eb-d71d-4156-926e-96439009988b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:37.572188 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9a4127eb-d71d-4156-926e-96439009988b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:37.589816 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a4127eb-d71d-4156-926e-96439009988b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:37.595642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a4127eb-d71d-4156-926e-96439009988b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:37.598766 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a4127eb-d71d-4156-926e-96439009988b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:37.601371 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a4127eb-d71d-4156-926e-96439009988b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:37.602949 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a4127eb-d71d-4156-926e-96439009988b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:37.605213 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a4127eb-d71d-4156-926e-96439009988b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:37.634766 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:37.635845 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:37.654759 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:37.656158 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:37.657116 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:37.662093 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:37.662756 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:37.663223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:38.297965 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9a4127eb-d71d-4156-926e-96439009988b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:38.305051 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:38.314266 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9a4127eb-d71d-4156-926e-96439009988b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1366 microversion: 2.1 time: 0.751140 Aug 12 06:53:38.315613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 340/682] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:37 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1366 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:38.320491 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2721470e-f36d-4161-93ba-cc30d6cf37f5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:38.321243 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2721470e-f36d-4161-93ba-cc30d6cf37f5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:38.327370 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2721470e-f36d-4161-93ba-cc30d6cf37f5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:38.328027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2721470e-f36d-4161-93ba-cc30d6cf37f5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:38.328454 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2721470e-f36d-4161-93ba-cc30d6cf37f5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:38.329293 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2721470e-f36d-4161-93ba-cc30d6cf37f5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:38.329692 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:38.330079 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2721470e-f36d-4161-93ba-cc30d6cf37f5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:38.330637 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2721470e-f36d-4161-93ba-cc30d6cf37f5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:38.332725 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:38.334346 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3ed6f05d-f86d-491d-81b3-0798fc2807a8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.705302 Aug 12 06:53:38.336702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 343/683] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:37 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:38.533538 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2721470e-f36d-4161-93ba-cc30d6cf37f5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:38.545642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2721470e-f36d-4161-93ba-cc30d6cf37f5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1363 microversion: 2.1 time: 0.226022 Aug 12 06:53:38.558632 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 341/684] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:38 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:39.337716 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-df90b8d1-0edd-49c2-95cc-a74f1628848f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:39.338332 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-df90b8d1-0edd-49c2-95cc-a74f1628848f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:39.347004 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df90b8d1-0edd-49c2-95cc-a74f1628848f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:39.347416 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df90b8d1-0edd-49c2-95cc-a74f1628848f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:39.347851 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df90b8d1-0edd-49c2-95cc-a74f1628848f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:39.348563 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df90b8d1-0edd-49c2-95cc-a74f1628848f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:39.349016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df90b8d1-0edd-49c2-95cc-a74f1628848f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:39.349439 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df90b8d1-0edd-49c2-95cc-a74f1628848f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:39.360445 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:39.361311 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:39.373413 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:39.375453 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:39.376182 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:39.376722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:39.377729 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:39.382186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:39.382638 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:39.609092 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:39.629073 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:39.630595 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:39.635492 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-61686f7e-f58e-4d1e-8690-ded1498cfdcc tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.276513 Aug 12 06:53:39.636778 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 342/685] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:39 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:53:39.656010 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e6289f5b-7854-4382-a57c-57c4c0d6d899 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:39.656879 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e6289f5b-7854-4382-a57c-57c4c0d6d899 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:39.670667 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6289f5b-7854-4382-a57c-57c4c0d6d899 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:39.671196 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6289f5b-7854-4382-a57c-57c4c0d6d899 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:39.671645 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6289f5b-7854-4382-a57c-57c4c0d6d899 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:39.682100 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6289f5b-7854-4382-a57c-57c4c0d6d899 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:39.682960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-df90b8d1-0edd-49c2-95cc-a74f1628848f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:39.684527 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6289f5b-7854-4382-a57c-57c4c0d6d899 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:39.684985 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e6289f5b-7854-4382-a57c-57c4c0d6d899 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:39.694958 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-df90b8d1-0edd-49c2-95cc-a74f1628848f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1366 microversion: 2.1 time: 0.361029 Aug 12 06:53:39.697717 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 344/686] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:39 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:39.932607 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e6289f5b-7854-4382-a57c-57c4c0d6d899 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:39.942103 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e6289f5b-7854-4382-a57c-57c4c0d6d899 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1550 microversion: 2.1 time: 0.304004 Aug 12 06:53:39.942689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 343/687] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:39 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1550 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:39.965018 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5e93afbc-211e-4702-92d2-3f22132e8004 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:39.966204 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5e93afbc-211e-4702-92d2-3f22132e8004 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:39.973853 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e93afbc-211e-4702-92d2-3f22132e8004 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:39.974775 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e93afbc-211e-4702-92d2-3f22132e8004 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:39.975612 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e93afbc-211e-4702-92d2-3f22132e8004 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:39.976574 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e93afbc-211e-4702-92d2-3f22132e8004 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:39.989208 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e93afbc-211e-4702-92d2-3f22132e8004 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:39.991601 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e93afbc-211e-4702-92d2-3f22132e8004 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:40.185001 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5e93afbc-211e-4702-92d2-3f22132e8004 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.224818 Aug 12 06:53:40.194453 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 345/688] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 06:53:39 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-interface => generated 285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:40.660442 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:40.661071 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:40.673928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:40.674559 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:40.675025 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:40.675754 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:40.676211 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:40.679830 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:40.718540 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4e65ac7d-34a4-4a7f-9f25-9e999bcc59d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:40.719945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4e65ac7d-34a4-4a7f-9f25-9e999bcc59d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:40.734027 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e65ac7d-34a4-4a7f-9f25-9e999bcc59d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:40.737074 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e65ac7d-34a4-4a7f-9f25-9e999bcc59d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:40.737698 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e65ac7d-34a4-4a7f-9f25-9e999bcc59d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:40.740359 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e65ac7d-34a4-4a7f-9f25-9e999bcc59d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:40.741025 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e65ac7d-34a4-4a7f-9f25-9e999bcc59d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:40.741624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e65ac7d-34a4-4a7f-9f25-9e999bcc59d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:41.122863 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:41.139740 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:41.141721 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:41.146445 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c3cbe29f-503d-4a62-9f8b-e0b36f90892a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.486461 Aug 12 06:53:41.147088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 344/689] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:40 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:41.168278 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4e65ac7d-34a4-4a7f-9f25-9e999bcc59d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:41.178526 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4e65ac7d-34a4-4a7f-9f25-9e999bcc59d8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1366 microversion: 2.1 time: 0.464427 Aug 12 06:53:41.180775 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 346/690] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:40 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1366 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:53:42.083211 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-423db593-4975-4fbf-b72d-310c4bad5185 req-3129cada-f5ef-413b-a535-674022481fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec690cd-9235-4c52-95c6-b6f74a37e813", "tag": "e7f7943f-2c08-4fad-af7b-e7c8e55bd098"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:42.094138 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-423db593-4975-4fbf-b72d-310c4bad5185 req-3129cada-f5ef-413b-a535-674022481fa4 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:42.094612 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-423db593-4975-4fbf-b72d-310c4bad5185 req-3129cada-f5ef-413b-a535-674022481fa4 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:42.095065 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-423db593-4975-4fbf-b72d-310c4bad5185 req-3129cada-f5ef-413b-a535-674022481fa4 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:42.109973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-423db593-4975-4fbf-b72d-310c4bad5185 req-3129cada-f5ef-413b-a535-674022481fa4 service nova] Creating event network-changed:e7f7943f-2c08-4fad-af7b-e7c8e55bd098 for instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 on hv-cinder-84457 Aug 12 06:53:42.115142 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-423db593-4975-4fbf-b72d-310c4bad5185 req-3129cada-f5ef-413b-a535-674022481fa4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232593 Aug 12 06:53:42.116227 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 345/691] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:53:42.183318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:42.184566 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:42.188049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:42.201915 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ddbd0d3a-3cf5-4b8e-873b-69621935c574 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:42.202953 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ddbd0d3a-3cf5-4b8e-873b-69621935c574 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:42.213371 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:42.215648 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:42.220979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:42.222633 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddbd0d3a-3cf5-4b8e-873b-69621935c574 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:42.223772 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddbd0d3a-3cf5-4b8e-873b-69621935c574 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:42.224254 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:42.224841 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddbd0d3a-3cf5-4b8e-873b-69621935c574 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:42.226910 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddbd0d3a-3cf5-4b8e-873b-69621935c574 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:42.227065 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:42.227748 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:42.228559 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddbd0d3a-3cf5-4b8e-873b-69621935c574 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:42.230237 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddbd0d3a-3cf5-4b8e-873b-69621935c574 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:42.467461 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=14 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:42.503514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:42.519220 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:42.521238 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:42.521980 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e3a13f31-37b3-414b-9fa6-202217ccdcb3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.353904 Aug 12 06:53:42.522775 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 347/692] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:42 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:42.552001 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-45f6fddb-b610-44ad-989c-89aa630a0f64 req-9b5beced-8bae-4156-bee2-7f52685dc4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9145d8-3483-4e57-8350-b4b26927dff1", "name": "network-vif-plugged", "status": "completed", "tag": "9be0b6eb-1b87-4534-89f5-a3b7efc1f96d"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:42.553874 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ddbd0d3a-3cf5-4b8e-873b-69621935c574 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:42.572305 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-45f6fddb-b610-44ad-989c-89aa630a0f64 req-9b5beced-8bae-4156-bee2-7f52685dc4fd service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:42.572783 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-45f6fddb-b610-44ad-989c-89aa630a0f64 req-9b5beced-8bae-4156-bee2-7f52685dc4fd service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:42.573209 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-45f6fddb-b610-44ad-989c-89aa630a0f64 req-9b5beced-8bae-4156-bee2-7f52685dc4fd service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:42.573408 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ddbd0d3a-3cf5-4b8e-873b-69621935c574 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1366 microversion: 2.1 time: 0.374790 Aug 12 06:53:42.574074 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 346/693] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:42 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:42.598208 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-45f6fddb-b610-44ad-989c-89aa630a0f64 req-9b5beced-8bae-4156-bee2-7f52685dc4fd service nova] Creating event network-vif-plugged:9be0b6eb-1b87-4534-89f5-a3b7efc1f96d for instance da9145d8-3483-4e57-8350-b4b26927dff1 on hv-cinder-84457 Aug 12 06:53:42.607018 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-45f6fddb-b610-44ad-989c-89aa630a0f64 req-9b5beced-8bae-4156-bee2-7f52685dc4fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083223 Aug 12 06:53:42.607821 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 348/694] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:43.553813 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:43.555403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:43.562597 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:43.563261 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:43.563804 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:43.564595 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:43.565104 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:43.565592 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:43.595187 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1858290b-c64c-4a8e-bc65-320aa6c8ac6f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:43.596541 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1858290b-c64c-4a8e-bc65-320aa6c8ac6f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:43.614373 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1858290b-c64c-4a8e-bc65-320aa6c8ac6f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:43.615224 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1858290b-c64c-4a8e-bc65-320aa6c8ac6f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:43.617576 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1858290b-c64c-4a8e-bc65-320aa6c8ac6f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:43.618489 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1858290b-c64c-4a8e-bc65-320aa6c8ac6f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:43.619180 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1858290b-c64c-4a8e-bc65-320aa6c8ac6f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:43.621507 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1858290b-c64c-4a8e-bc65-320aa6c8ac6f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:43.755650 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:43.767786 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:43.769963 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:43.772316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e8add6f6-ccdc-41af-a159-146875d7693c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.223894 Aug 12 06:53:43.773107 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 347/695] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:43 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:53:43.815855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1858290b-c64c-4a8e-bc65-320aa6c8ac6f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:43.827761 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1858290b-c64c-4a8e-bc65-320aa6c8ac6f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1366 microversion: 2.1 time: 0.237269 Aug 12 06:53:43.828850 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 349/696] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:43 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:44.797906 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:44.798456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:44.804940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:44.805602 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:44.806178 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:44.807038 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:44.807644 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:44.808626 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:44.850459 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d507a73a-4738-4888-b3ad-93565a38d66f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:44.852528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d507a73a-4738-4888-b3ad-93565a38d66f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:44.861459 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d507a73a-4738-4888-b3ad-93565a38d66f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:44.862030 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d507a73a-4738-4888-b3ad-93565a38d66f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:44.862523 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d507a73a-4738-4888-b3ad-93565a38d66f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:44.863305 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d507a73a-4738-4888-b3ad-93565a38d66f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:44.863970 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d507a73a-4738-4888-b3ad-93565a38d66f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:44.864651 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d507a73a-4738-4888-b3ad-93565a38d66f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:45.004276 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:45.015952 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:45.018009 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:45.020577 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1e7ab86a-3096-4142-ae7e-f61eed931fdb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.226614 Aug 12 06:53:45.021402 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 348/697] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:44 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:45.049492 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d507a73a-4738-4888-b3ad-93565a38d66f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:45.056973 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d507a73a-4738-4888-b3ad-93565a38d66f tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1366 microversion: 2.1 time: 0.211678 Aug 12 06:53:45.057535 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 350/698] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:44 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:53:46.043492 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:46.044985 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:46.052415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:46.053278 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:46.053809 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:46.054614 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:46.055171 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:46.055659 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:46.081881 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-491df619-26f2-462e-b6e9-fe8b19954e30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:46.083521 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-491df619-26f2-462e-b6e9-fe8b19954e30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:46.090651 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-491df619-26f2-462e-b6e9-fe8b19954e30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:46.091448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-491df619-26f2-462e-b6e9-fe8b19954e30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:46.092164 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-491df619-26f2-462e-b6e9-fe8b19954e30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:46.093352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-491df619-26f2-462e-b6e9-fe8b19954e30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:46.093994 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-491df619-26f2-462e-b6e9-fe8b19954e30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:46.094884 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-491df619-26f2-462e-b6e9-fe8b19954e30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:46.254593 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:46.266765 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:46.271107 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:46.272482 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b26bd9e9-51b0-4625-b76e-9dc7ba17a106 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.233130 Aug 12 06:53:46.273219 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 349/699] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:46 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:46.341663 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-491df619-26f2-462e-b6e9-fe8b19954e30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:46.350416 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-491df619-26f2-462e-b6e9-fe8b19954e30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1366 microversion: 2.1 time: 0.272365 Aug 12 06:53:46.351854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 351/700] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:46 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:47.296225 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:47.296868 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:47.303930 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:47.304407 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:47.304832 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:47.305528 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:47.305975 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:47.306397 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:47.349512 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c561a276-d599-474e-83a0-13ac7f64e7e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Action: 'create', calling method: .version_select at 0x7fc704d8d310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1446519245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV2YfVP61zl/ess8jY0LL8CxCHXFWeuj6UV3wYVZlJ6pdO/Ahq0+Y95kiW8KqUfs6nIGgCR/uJMDirAPFKXQmlykB6CDPN8JNEo50RDnlm8dEFiTRr2RLth8G/uls1wZg=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:47.366097 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-c561a276-d599-474e-83a0-13ac7f64e7e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Getting quotas for project a5bda0f141e844dcae39d3a687543744. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:53:47.368451 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:47.371347 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-c561a276-d599-474e-83a0-13ac7f64e7e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Getting quotas for user f6a076962b774301a7c9530db7579943 and project a5bda0f141e844dcae39d3a687543744. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:53:47.398308 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c561a276-d599-474e-83a0-13ac7f64e7e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052703 Aug 12 06:53:47.398964 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 352/701] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 06:53:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:47.403654 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-55dfbb33-b18e-4d05-8040-466f5790fac7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:47.404327 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-55dfbb33-b18e-4d05-8040-466f5790fac7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:47.416579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55dfbb33-b18e-4d05-8040-466f5790fac7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:47.417176 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55dfbb33-b18e-4d05-8040-466f5790fac7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:47.418035 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55dfbb33-b18e-4d05-8040-466f5790fac7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:47.418417 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55dfbb33-b18e-4d05-8040-466f5790fac7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:47.418961 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55dfbb33-b18e-4d05-8040-466f5790fac7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:47.419489 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-55dfbb33-b18e-4d05-8040-466f5790fac7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:47.445450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:47.453788 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:47.455299 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:47.456447 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-54cbe5ca-4804-4732-ae48-304c1e34bff1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1747 microversion: 2.20 time: 0.164238 Aug 12 06:53:47.457013 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 350/702] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:47 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1747 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:47.506999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-758112305", "imageRef": "d379a199-29a9-4bf2-864e-64f67e3cf02b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1446519245", "networks": [{"uuid": "cd70673d-a44f-4195-a77e-644ed772b2df"}]}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:47.559715 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] validate_networks() for [('cd70673d-a44f-4195-a77e-644ed772b2df', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:53:47.560611 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-55dfbb33-b18e-4d05-8040-466f5790fac7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:47.568411 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-55dfbb33-b18e-4d05-8040-466f5790fac7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1556 microversion: 2.1 time: 0.168324 Aug 12 06:53:47.569016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 353/703] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:47 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:47.588585 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-816856d0-2fb2-4b46-ba36-3462428e9f2a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:47.589101 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-816856d0-2fb2-4b46-ba36-3462428e9f2a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:47.595138 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-816856d0-2fb2-4b46-ba36-3462428e9f2a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:47.595795 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-816856d0-2fb2-4b46-ba36-3462428e9f2a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:47.596219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-816856d0-2fb2-4b46-ba36-3462428e9f2a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:47.596904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-816856d0-2fb2-4b46-ba36-3462428e9f2a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:47.597344 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-816856d0-2fb2-4b46-ba36-3462428e9f2a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:47.597753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-816856d0-2fb2-4b46-ba36-3462428e9f2a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:47.698794 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-816856d0-2fb2-4b46-ba36-3462428e9f2a tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113922 Aug 12 06:53:47.699431 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 354/704] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 06:53:47 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:53:48.059898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:53:48.060311 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:53:48.060769 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:53:48.061164 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:53:48.061561 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:53:48.070408 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:48.070878 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:48.071330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:48.072037 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:48.072484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:48.072892 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:48.089351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Getting quotas for project a5bda0f141e844dcae39d3a687543744. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:53:48.093213 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Getting quotas for user f6a076962b774301a7c9530db7579943 and project a5bda0f141e844dcae39d3a687543744. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:53:48.103973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:53:48.106342 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d379a199-29a9-4bf2-864e-64f67e3cf02b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:53:48.152051 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c521fe97-008d-40b6-a64b-226d63b591a0 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649118 Aug 12 06:53:48.152688 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 351/705] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:53:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 06:53:48.163437 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7bfc360c-ec9a-4724-b206-a13cdffd4fef tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:48.164047 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7bfc360c-ec9a-4724-b206-a13cdffd4fef tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:48.237709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7bfc360c-ec9a-4724-b206-a13cdffd4fef tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:48.244889 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7bfc360c-ec9a-4724-b206-a13cdffd4fef tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1258 microversion: 2.1 time: 0.085264 Aug 12 06:53:48.245518 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 355/706] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:48 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:48.482579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:48.484324 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:48.493029 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:48.493732 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:48.494291 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:48.495212 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:48.495911 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:48.496549 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:48.657072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:48.665592 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:48.667590 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:48.668919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c2122c7a-e6e6-4294-8b75-b49bac04ac62 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1747 microversion: 2.20 time: 0.193088 Aug 12 06:53:48.669956 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 352/707] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:48 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1747 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:48.692942 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-b8ad0708-67ef-4557-8762-04a720b24ce5 req-889cc1e1-f499-4b23-acef-e5c5fa84f43f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9145d8-3483-4e57-8350-b4b26927dff1", "tag": "9be0b6eb-1b87-4534-89f5-a3b7efc1f96d"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:48.704072 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b8ad0708-67ef-4557-8762-04a720b24ce5 req-889cc1e1-f499-4b23-acef-e5c5fa84f43f service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:48.704551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b8ad0708-67ef-4557-8762-04a720b24ce5 req-889cc1e1-f499-4b23-acef-e5c5fa84f43f service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:48.704975 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b8ad0708-67ef-4557-8762-04a720b24ce5 req-889cc1e1-f499-4b23-acef-e5c5fa84f43f service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:48.715719 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-b8ad0708-67ef-4557-8762-04a720b24ce5 req-889cc1e1-f499-4b23-acef-e5c5fa84f43f service nova] Creating event network-changed:9be0b6eb-1b87-4534-89f5-a3b7efc1f96d for instance da9145d8-3483-4e57-8350-b4b26927dff1 on hv-cinder-84457 Aug 12 06:53:48.721003 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-b8ad0708-67ef-4557-8762-04a720b24ce5 req-889cc1e1-f499-4b23-acef-e5c5fa84f43f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031904 Aug 12 06:53:48.721608 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 356/708] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:49.271890 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-65d4cd80-9e3b-4096-9d10-f6b7f0e47525 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:49.272604 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-65d4cd80-9e3b-4096-9d10-f6b7f0e47525 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:49.279578 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65d4cd80-9e3b-4096-9d10-f6b7f0e47525 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:49.280140 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65d4cd80-9e3b-4096-9d10-f6b7f0e47525 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:49.280639 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65d4cd80-9e3b-4096-9d10-f6b7f0e47525 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:49.281338 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65d4cd80-9e3b-4096-9d10-f6b7f0e47525 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:49.281786 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65d4cd80-9e3b-4096-9d10-f6b7f0e47525 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:49.282213 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65d4cd80-9e3b-4096-9d10-f6b7f0e47525 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:49.342532 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-65d4cd80-9e3b-4096-9d10-f6b7f0e47525 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:49.344879 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:49.351362 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-65d4cd80-9e3b-4096-9d10-f6b7f0e47525 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1262 microversion: 2.1 time: 0.085319 Aug 12 06:53:49.351947 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 353/709] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:49 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:49.700870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:49.702275 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:49.715331 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:49.715813 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:49.723041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:49.724036 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:49.724662 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:49.725277 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:49.748301 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:49.890527 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:49.902352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:49.905727 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:49.906902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-87c74ed6-a726-44ff-9378-b68e357e9c9f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1747 microversion: 2.20 time: 0.218832 Aug 12 06:53:49.919586 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 357/710] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:49 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1747 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:50.372081 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d282e956-e3b5-429f-8ab3-afcb07aeeb23 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:50.373381 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d282e956-e3b5-429f-8ab3-afcb07aeeb23 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:50.379839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d282e956-e3b5-429f-8ab3-afcb07aeeb23 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:50.380319 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d282e956-e3b5-429f-8ab3-afcb07aeeb23 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:50.380748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d282e956-e3b5-429f-8ab3-afcb07aeeb23 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:50.381521 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d282e956-e3b5-429f-8ab3-afcb07aeeb23 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:50.381940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d282e956-e3b5-429f-8ab3-afcb07aeeb23 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:50.382356 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d282e956-e3b5-429f-8ab3-afcb07aeeb23 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:50.447481 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d282e956-e3b5-429f-8ab3-afcb07aeeb23 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:50.455133 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d282e956-e3b5-429f-8ab3-afcb07aeeb23 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1310 microversion: 2.1 time: 0.087035 Aug 12 06:53:50.455724 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 354/711] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:50 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:50.783197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-b6153c8f-18ea-49dc-ab0d-a722086a10a9 req-e4bb75f2-a7fc-4b7e-8684-144a2edc2803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0893bde6-8eaf-4ca0-95bb-0c04c57e158e", "name": "network-vif-plugged", "status": "completed", "tag": "4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:53:50.796598 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b6153c8f-18ea-49dc-ab0d-a722086a10a9 req-e4bb75f2-a7fc-4b7e-8684-144a2edc2803 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:50.797235 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b6153c8f-18ea-49dc-ab0d-a722086a10a9 req-e4bb75f2-a7fc-4b7e-8684-144a2edc2803 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:50.797815 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b6153c8f-18ea-49dc-ab0d-a722086a10a9 req-e4bb75f2-a7fc-4b7e-8684-144a2edc2803 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:50.809823 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-b6153c8f-18ea-49dc-ab0d-a722086a10a9 req-e4bb75f2-a7fc-4b7e-8684-144a2edc2803 service nova] Creating event network-vif-plugged:4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc for instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e on hv-cinder-84457 Aug 12 06:53:50.815442 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-b6153c8f-18ea-49dc-ab0d-a722086a10a9 req-e4bb75f2-a7fc-4b7e-8684-144a2edc2803 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035664 Aug 12 06:53:50.816659 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 358/712] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:53:50.931642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:50.932457 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:50.938526 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:50.939119 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:50.939618 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:50.940382 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:50.940900 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:50.941390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:51.398060 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:51.409051 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:51.419564 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:51.422265 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6dc4cd0e-51d2-403f-8ed9-df61bf296ea6 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1747 microversion: 2.20 time: 0.494723 Aug 12 06:53:51.440225 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 355/713] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:50 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1747 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:51.478066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f0d62185-3cc6-4c07-a348-9da965ccb96a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:51.478753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f0d62185-3cc6-4c07-a348-9da965ccb96a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:51.499582 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0d62185-3cc6-4c07-a348-9da965ccb96a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:51.500202 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0d62185-3cc6-4c07-a348-9da965ccb96a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:51.500695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0d62185-3cc6-4c07-a348-9da965ccb96a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:51.501428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0d62185-3cc6-4c07-a348-9da965ccb96a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:51.501881 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0d62185-3cc6-4c07-a348-9da965ccb96a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:51.502294 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0d62185-3cc6-4c07-a348-9da965ccb96a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:51.745961 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f0d62185-3cc6-4c07-a348-9da965ccb96a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:51.755361 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f0d62185-3cc6-4c07-a348-9da965ccb96a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.282015 Aug 12 06:53:51.756098 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 359/714] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:51 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:52.446568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:52.447298 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:52.454236 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:52.454714 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:52.455175 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:52.455867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:52.456308 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:52.456718 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:52.591536 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:52.599532 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:52.601017 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:52.602164 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e0a1df16-b9d1-45e4-be8f-c7cdb5684ead tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1747 microversion: 2.20 time: 0.160298 Aug 12 06:53:52.602719 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 356/715] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:52 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:52.777500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6921b351-1285-4774-9488-c4f97c911ede tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:52.778113 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6921b351-1285-4774-9488-c4f97c911ede tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:52.784823 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6921b351-1285-4774-9488-c4f97c911ede tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:52.785299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6921b351-1285-4774-9488-c4f97c911ede tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:52.785726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6921b351-1285-4774-9488-c4f97c911ede tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:52.786411 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6921b351-1285-4774-9488-c4f97c911ede tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:52.786857 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6921b351-1285-4774-9488-c4f97c911ede tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:52.787300 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6921b351-1285-4774-9488-c4f97c911ede tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:52.928322 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6921b351-1285-4774-9488-c4f97c911ede tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:52.937886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6921b351-1285-4774-9488-c4f97c911ede tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.164327 Aug 12 06:53:52.938715 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 360/716] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:52 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:53:53.624572 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:53.625338 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:53.632383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:53.633207 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:53.633896 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:53.634863 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:53.635604 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:53.636269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:53.777968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:53.786436 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:53.788162 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:53.789744 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bd33011a-ef45-4be6-8143-2c16000670f2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1747 microversion: 2.20 time: 0.169470 Aug 12 06:53:53.790304 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 357/717] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:53 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1747 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:53.960298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-628b30c4-c763-4e44-a05d-d695c114477b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:53.960878 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-628b30c4-c763-4e44-a05d-d695c114477b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:53.967622 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-628b30c4-c763-4e44-a05d-d695c114477b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:53.968107 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-628b30c4-c763-4e44-a05d-d695c114477b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:53.968529 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-628b30c4-c763-4e44-a05d-d695c114477b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:53.969217 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-628b30c4-c763-4e44-a05d-d695c114477b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:53.969659 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-628b30c4-c763-4e44-a05d-d695c114477b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:53.970065 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-628b30c4-c763-4e44-a05d-d695c114477b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:54.110664 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-628b30c4-c763-4e44-a05d-d695c114477b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:54.118235 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-628b30c4-c763-4e44-a05d-d695c114477b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.162179 Aug 12 06:53:54.118797 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 361/718] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:53 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:54.813955 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:54.814602 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:54.821367 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:54.822180 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:54.822727 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:54.823739 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:54.824196 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:54.824836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:54.962760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:54.972311 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:54.973840 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:54.975215 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bce24e3d-c750-4dcb-9628-c71a62fefc64 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1747 microversion: 2.20 time: 0.165262 Aug 12 06:53:54.975958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 358/719] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:54 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:55.139590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-be9ee816-74a2-4bbc-8e45-5fb8c4817206 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:55.140155 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-be9ee816-74a2-4bbc-8e45-5fb8c4817206 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:55.146456 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be9ee816-74a2-4bbc-8e45-5fb8c4817206 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:55.146931 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be9ee816-74a2-4bbc-8e45-5fb8c4817206 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:55.147384 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be9ee816-74a2-4bbc-8e45-5fb8c4817206 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:55.148213 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be9ee816-74a2-4bbc-8e45-5fb8c4817206 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:55.148781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be9ee816-74a2-4bbc-8e45-5fb8c4817206 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:55.149199 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be9ee816-74a2-4bbc-8e45-5fb8c4817206 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:55.288976 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-be9ee816-74a2-4bbc-8e45-5fb8c4817206 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:55.311666 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-be9ee816-74a2-4bbc-8e45-5fb8c4817206 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.163620 Aug 12 06:53:55.312436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 362/720] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:55 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:55.999992 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:56.000845 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:56.007748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:56.008349 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:56.008785 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:56.009483 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:56.009998 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:56.010412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:56.169858 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:56.179078 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:56.180885 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:56.182636 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e8171581-92f6-4da5-908f-15e1ecfd6290 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1747 microversion: 2.20 time: 0.186957 Aug 12 06:53:56.183357 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 359/721] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:55 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1747 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:56.332861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c8a28713-1f6d-4747-b9f6-c343457fd448 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:56.334177 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c8a28713-1f6d-4747-b9f6-c343457fd448 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:56.341225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8a28713-1f6d-4747-b9f6-c343457fd448 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:56.341954 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8a28713-1f6d-4747-b9f6-c343457fd448 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:56.342529 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8a28713-1f6d-4747-b9f6-c343457fd448 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:56.343421 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8a28713-1f6d-4747-b9f6-c343457fd448 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:56.343866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8a28713-1f6d-4747-b9f6-c343457fd448 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:56.344274 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8a28713-1f6d-4747-b9f6-c343457fd448 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:56.485632 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c8a28713-1f6d-4747-b9f6-c343457fd448 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:56.493962 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c8a28713-1f6d-4747-b9f6-c343457fd448 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.164931 Aug 12 06:53:56.494624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 363/722] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:56 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:57.206026 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:57.207326 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:57.214781 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:57.215302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:57.215732 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:57.216432 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:57.216920 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:57.217334 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:57.358428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:57.367818 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:57.369295 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:57.370482 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9aebbf42-2616-4193-80a4-2c7945972e0b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1747 microversion: 2.20 time: 0.168616 Aug 12 06:53:57.371252 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 360/723] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:57 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:57.522320 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-79a75347-8470-40ea-aa1a-be0c6fcc59bd tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:57.523048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-79a75347-8470-40ea-aa1a-be0c6fcc59bd tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:57.529724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79a75347-8470-40ea-aa1a-be0c6fcc59bd tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:57.530464 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79a75347-8470-40ea-aa1a-be0c6fcc59bd tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:57.530894 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79a75347-8470-40ea-aa1a-be0c6fcc59bd tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:57.531619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79a75347-8470-40ea-aa1a-be0c6fcc59bd tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:57.532070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79a75347-8470-40ea-aa1a-be0c6fcc59bd tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:57.532529 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79a75347-8470-40ea-aa1a-be0c6fcc59bd tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:57.679053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-79a75347-8470-40ea-aa1a-be0c6fcc59bd tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:57.695694 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-79a75347-8470-40ea-aa1a-be0c6fcc59bd tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.179973 Aug 12 06:53:57.696395 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 364/724] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:57 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:58.394413 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:58.395061 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:58.397227 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:58.398159 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:58.404883 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:58.405377 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:58.405770 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:58.406673 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:58.407150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:58.407561 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:58.558565 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:58.567257 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:58.568831 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:58.569906 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f3caf2e1-1565-4988-bb6b-58861a290d69 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1747 microversion: 2.20 time: 0.179894 Aug 12 06:53:58.570466 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 361/725] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:58 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1747 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:58.718485 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-de21e9e3-886b-44c9-b9ec-170b1ecc8f8b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:58.719163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-de21e9e3-886b-44c9-b9ec-170b1ecc8f8b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:58.721230 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:53:58.727530 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de21e9e3-886b-44c9-b9ec-170b1ecc8f8b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:58.727995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de21e9e3-886b-44c9-b9ec-170b1ecc8f8b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:58.728413 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de21e9e3-886b-44c9-b9ec-170b1ecc8f8b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:58.729099 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de21e9e3-886b-44c9-b9ec-170b1ecc8f8b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:58.729584 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de21e9e3-886b-44c9-b9ec-170b1ecc8f8b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:58.729981 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de21e9e3-886b-44c9-b9ec-170b1ecc8f8b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:58.875945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-de21e9e3-886b-44c9-b9ec-170b1ecc8f8b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:58.889061 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-de21e9e3-886b-44c9-b9ec-170b1ecc8f8b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.174440 Aug 12 06:53:58.890552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 365/726] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:58 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:53:59.595748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:59.596594 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:59.605197 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:59.605823 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:59.606375 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:59.607283 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:59.607849 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:59.608384 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:59.753617 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:59.762068 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:59.763596 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:53:59.764776 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ce8b733c-ba12-4877-bb09-6cdd706f934a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1747 microversion: 2.20 time: 0.174872 Aug 12 06:53:59.765350 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 362/727] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:53:59 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1747 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:53:59.909799 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8e889045-4009-471b-8dfa-fbab70a8847c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:53:59.910709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8e889045-4009-471b-8dfa-fbab70a8847c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:53:59.917562 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e889045-4009-471b-8dfa-fbab70a8847c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:59.918315 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e889045-4009-471b-8dfa-fbab70a8847c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:59.918995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e889045-4009-471b-8dfa-fbab70a8847c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:53:59.920192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e889045-4009-471b-8dfa-fbab70a8847c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:53:59.921161 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e889045-4009-471b-8dfa-fbab70a8847c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:53:59.921603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e889045-4009-471b-8dfa-fbab70a8847c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:00.132536 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8e889045-4009-471b-8dfa-fbab70a8847c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:00.140274 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8e889045-4009-471b-8dfa-fbab70a8847c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.234380 Aug 12 06:54:00.140840 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 366/728] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:53:59 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:00.470492 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-1c440e5a-4d33-4591-b2fb-e5687ba2a5ae req-4faec0e4-e298-4f04-bb08-406d30ce986d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f087d0a-dd24-4db2-9492-7d2ff7a5d63d", "tag": "96a99562-8ad9-44c6-b596-af4b26f087ae"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:00.493791 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1c440e5a-4d33-4591-b2fb-e5687ba2a5ae req-4faec0e4-e298-4f04-bb08-406d30ce986d service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:00.494735 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1c440e5a-4d33-4591-b2fb-e5687ba2a5ae req-4faec0e4-e298-4f04-bb08-406d30ce986d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:00.495452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1c440e5a-4d33-4591-b2fb-e5687ba2a5ae req-4faec0e4-e298-4f04-bb08-406d30ce986d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:00.521215 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-1c440e5a-4d33-4591-b2fb-e5687ba2a5ae req-4faec0e4-e298-4f04-bb08-406d30ce986d service nova] Creating event network-changed:96a99562-8ad9-44c6-b596-af4b26f087ae for instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d on hv-cinder-84457 Aug 12 06:54:00.535635 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-1c440e5a-4d33-4591-b2fb-e5687ba2a5ae req-4faec0e4-e298-4f04-bb08-406d30ce986d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074243 Aug 12 06:54:00.536968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 363/729] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:00.788928 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:00.789558 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:00.803256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:00.804648 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:00.805497 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:00.807206 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:00.808228 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:00.809509 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:00.980854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:00.989341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:00.991144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:00.992529 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8f4fc76f-8b0c-4f9e-a10c-3fb62cbede2a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1742 microversion: 2.20 time: 0.208275 Aug 12 06:54:01.009303 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 367/730] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:00 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:01.164172 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-20dc413f-6817-4d84-8d66-e92087b1df30 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:01.165376 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-20dc413f-6817-4d84-8d66-e92087b1df30 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:01.177359 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-20dc413f-6817-4d84-8d66-e92087b1df30 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:01.177938 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-20dc413f-6817-4d84-8d66-e92087b1df30 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:01.178448 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-20dc413f-6817-4d84-8d66-e92087b1df30 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:01.186475 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-20dc413f-6817-4d84-8d66-e92087b1df30 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:01.186999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-20dc413f-6817-4d84-8d66-e92087b1df30 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:01.187434 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-20dc413f-6817-4d84-8d66-e92087b1df30 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:01.471121 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-20dc413f-6817-4d84-8d66-e92087b1df30 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:01.479401 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-20dc413f-6817-4d84-8d66-e92087b1df30 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.320875 Aug 12 06:54:01.479991 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 364/731] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:01 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:02.018156 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:02.019314 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:02.026225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:02.027002 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:02.027611 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:02.028500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:02.029109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:02.029686 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:02.202339 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:02.212166 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:02.216201 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:02.217686 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-243f79ea-535d-4805-b54c-7e0c2ebfe51e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1742 microversion: 2.20 time: 0.204559 Aug 12 06:54:02.232941 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 368/732] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:02 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1742 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:02.500125 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bf3d2e84-14f2-4a46-94f7-1499f15a542c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:02.501416 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bf3d2e84-14f2-4a46-94f7-1499f15a542c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:02.508163 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf3d2e84-14f2-4a46-94f7-1499f15a542c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:02.508920 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf3d2e84-14f2-4a46-94f7-1499f15a542c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:02.509522 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf3d2e84-14f2-4a46-94f7-1499f15a542c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:02.510479 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf3d2e84-14f2-4a46-94f7-1499f15a542c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:02.511120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf3d2e84-14f2-4a46-94f7-1499f15a542c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:02.511718 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf3d2e84-14f2-4a46-94f7-1499f15a542c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:02.748462 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bf3d2e84-14f2-4a46-94f7-1499f15a542c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:02.757774 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bf3d2e84-14f2-4a46-94f7-1499f15a542c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.261486 Aug 12 06:54:02.772043 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 365/733] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:02 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:03.241430 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:03.242604 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:03.251134 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:03.252253 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:03.252898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:03.254004 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:03.254730 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:03.255613 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:03.441531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:03.462643 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:03.464822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:03.466484 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6d7651b6-a63e-4f33-845b-b49923d994d9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1742 microversion: 2.20 time: 0.229481 Aug 12 06:54:03.467079 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 369/734] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:03 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1742 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:03.781966 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9ac4f16b-8085-49ec-adbc-dfdced808eb2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:03.782617 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9ac4f16b-8085-49ec-adbc-dfdced808eb2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:03.789186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ac4f16b-8085-49ec-adbc-dfdced808eb2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:03.789914 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ac4f16b-8085-49ec-adbc-dfdced808eb2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:03.790339 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ac4f16b-8085-49ec-adbc-dfdced808eb2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:03.791033 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ac4f16b-8085-49ec-adbc-dfdced808eb2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:03.791477 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ac4f16b-8085-49ec-adbc-dfdced808eb2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:03.792175 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ac4f16b-8085-49ec-adbc-dfdced808eb2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:03.951031 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9ac4f16b-8085-49ec-adbc-dfdced808eb2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:03.959412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9ac4f16b-8085-49ec-adbc-dfdced808eb2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.181562 Aug 12 06:54:03.960835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 366/735] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:03 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:04.491133 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:04.491844 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:04.503874 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:04.508653 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:04.509313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:04.510260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:04.510864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:04.511456 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:04.747590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:04.763585 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:04.770346 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:04.772405 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-efcf17b5-d431-4eaa-a2f0-dcffe6767164 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1742 microversion: 2.20 time: 0.286453 Aug 12 06:54:04.775365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 370/736] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:04 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1742 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:54:04.981886 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-67db612e-e53f-46e1-8483-c177b698dea7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:04.984200 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-67db612e-e53f-46e1-8483-c177b698dea7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:04.993552 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67db612e-e53f-46e1-8483-c177b698dea7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:04.994398 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67db612e-e53f-46e1-8483-c177b698dea7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:04.995185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67db612e-e53f-46e1-8483-c177b698dea7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:04.996865 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67db612e-e53f-46e1-8483-c177b698dea7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:04.998129 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67db612e-e53f-46e1-8483-c177b698dea7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:04.998760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-67db612e-e53f-46e1-8483-c177b698dea7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:05.169832 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-67db612e-e53f-46e1-8483-c177b698dea7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:05.179491 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-67db612e-e53f-46e1-8483-c177b698dea7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.202341 Aug 12 06:54:05.180275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 367/737] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:04 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:05.798086 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:05.799526 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:05.806471 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:05.806963 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:05.807664 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:05.808382 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:05.808989 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:05.809560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:05.970130 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:05.978916 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:05.980430 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:05.982022 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-af24cded-2a07-4280-a2de-1116f66adb25 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1742 microversion: 2.20 time: 0.187741 Aug 12 06:54:05.995242 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 371/738] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:05 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1742 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:06.209619 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-123275f1-f785-4a14-8edf-71cd3a014c61 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:06.210970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-123275f1-f785-4a14-8edf-71cd3a014c61 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:06.217526 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-123275f1-f785-4a14-8edf-71cd3a014c61 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:06.218664 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-123275f1-f785-4a14-8edf-71cd3a014c61 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:06.219144 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-123275f1-f785-4a14-8edf-71cd3a014c61 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:06.221472 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-123275f1-f785-4a14-8edf-71cd3a014c61 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:06.222101 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-123275f1-f785-4a14-8edf-71cd3a014c61 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:06.222724 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-123275f1-f785-4a14-8edf-71cd3a014c61 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:06.263965 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1220517680", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "networks": [{"uuid": "38b3e8b2-62af-42af-9068-4d777853423a"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:06.327826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] validate_networks() for [('38b3e8b2-62af-42af-9068-4d777853423a', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:54:06.439595 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-123275f1-f785-4a14-8edf-71cd3a014c61 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:06.451481 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-123275f1-f785-4a14-8edf-71cd3a014c61 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.246874 Aug 12 06:54:06.467168 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 368/739] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:06 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:06.789558 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:54:06.789969 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:54:06.790631 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:54:06.791165 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:54:06.791589 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:54:06.800519 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:06.801222 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:06.801398 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:06.802318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:06.802767 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:06.803207 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:06.820909 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Getting quotas for project ba21c1ff37bd41c0a490ec609d5d4f22. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:54:06.824956 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Getting quotas for user e8174b2b7d024b24b6d6c3578b273691 and project ba21c1ff37bd41c0a490ec609d5d4f22. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:54:06.837402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:54:06.840165 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:54:06.866931 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-bddc4bac-09d1-4995-be6b-c134885fff68 req-dcbaa70f-9efd-4c25-96fc-c5b1d7c8dda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f087d0a-dd24-4db2-9492-7d2ff7a5d63d", "name": "network-vif-plugged", "status": "completed", "tag": "96a99562-8ad9-44c6-b596-af4b26f087ae"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:06.885707 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-bddc4bac-09d1-4995-be6b-c134885fff68 req-dcbaa70f-9efd-4c25-96fc-c5b1d7c8dda9 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:06.886771 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-bddc4bac-09d1-4995-be6b-c134885fff68 req-dcbaa70f-9efd-4c25-96fc-c5b1d7c8dda9 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:06.887274 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-bddc4bac-09d1-4995-be6b-c134885fff68 req-dcbaa70f-9efd-4c25-96fc-c5b1d7c8dda9 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:06.916996 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-bddc4bac-09d1-4995-be6b-c134885fff68 req-dcbaa70f-9efd-4c25-96fc-c5b1d7c8dda9 service nova] Creating event network-vif-plugged:96a99562-8ad9-44c6-b596-af4b26f087ae for instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d on hv-cinder-84457 Aug 12 06:54:06.917797 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-25dd2a4b-594c-497b-8d72-d8c00994b5b6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654464 Aug 12 06:54:06.921877 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 372/740] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:54:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:54:06.923823 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-bddc4bac-09d1-4995-be6b-c134885fff68 req-dcbaa70f-9efd-4c25-96fc-c5b1d7c8dda9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062294 Aug 12 06:54:06.924876 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 369/741] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:54:06.935020 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f5991206-ace8-47c7-b198-0938469c391c tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:06.937237 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f5991206-ace8-47c7-b198-0938469c391c tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:07.006315 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f5991206-ace8-47c7-b198-0938469c391c tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:07.011690 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:07.012714 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:07.014403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f5991206-ace8-47c7-b198-0938469c391c tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1214 microversion: 2.1 time: 0.085476 Aug 12 06:54:07.015021 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 373/742] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:06 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:07.028364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:07.028364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:07.028364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:07.028364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:07.029368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:07.029368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:07.223606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:07.237893 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:07.240185 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:07.241230 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8f4966b6-db3b-4206-bbff-69ffa9d30b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1742 microversion: 2.20 time: 0.239474 Aug 12 06:54:07.241768 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 370/743] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:07 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1742 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:07.474333 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2d2aa374-f96c-4a99-9ebb-414b0eeb9460 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:07.475372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2d2aa374-f96c-4a99-9ebb-414b0eeb9460 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:07.482842 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2aa374-f96c-4a99-9ebb-414b0eeb9460 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:07.483587 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2aa374-f96c-4a99-9ebb-414b0eeb9460 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:07.484229 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2aa374-f96c-4a99-9ebb-414b0eeb9460 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:07.484930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2aa374-f96c-4a99-9ebb-414b0eeb9460 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:07.485375 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2aa374-f96c-4a99-9ebb-414b0eeb9460 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:07.485805 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2aa374-f96c-4a99-9ebb-414b0eeb9460 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:07.642128 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2d2aa374-f96c-4a99-9ebb-414b0eeb9460 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:07.656095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2d2aa374-f96c-4a99-9ebb-414b0eeb9460 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.185647 Aug 12 06:54:07.657040 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 374/744] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:07 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:08.036085 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9d58a309-bcb6-4c86-bb7d-fbccab244e9f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:08.036690 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9d58a309-bcb6-4c86-bb7d-fbccab244e9f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:08.043224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d58a309-bcb6-4c86-bb7d-fbccab244e9f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:08.043925 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d58a309-bcb6-4c86-bb7d-fbccab244e9f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:08.044524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d58a309-bcb6-4c86-bb7d-fbccab244e9f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:08.045389 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d58a309-bcb6-4c86-bb7d-fbccab244e9f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:08.046396 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d58a309-bcb6-4c86-bb7d-fbccab244e9f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:08.046750 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d58a309-bcb6-4c86-bb7d-fbccab244e9f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:08.117874 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9d58a309-bcb6-4c86-bb7d-fbccab244e9f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:08.120770 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:08.127840 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9d58a309-bcb6-4c86-bb7d-fbccab244e9f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1210 microversion: 2.1 time: 0.095568 Aug 12 06:54:08.128413 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 371/745] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:08 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:08.264518 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:08.266122 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:08.275499 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:08.276143 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:08.276688 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:08.277438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:08.277968 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:08.278564 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:08.422300 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:08.432350 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:08.434386 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:08.435767 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-17da3732-8d8c-40f0-b3e5-bc543a4b70b1 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1742 microversion: 2.20 time: 0.175233 Aug 12 06:54:08.436365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 375/746] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:08 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1742 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:08.681531 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-53bad2d0-8314-4149-9234-f7b37f589814 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:08.682856 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-53bad2d0-8314-4149-9234-f7b37f589814 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:08.689931 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53bad2d0-8314-4149-9234-f7b37f589814 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:08.690401 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53bad2d0-8314-4149-9234-f7b37f589814 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:08.690824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53bad2d0-8314-4149-9234-f7b37f589814 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:08.691539 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53bad2d0-8314-4149-9234-f7b37f589814 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:08.692143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53bad2d0-8314-4149-9234-f7b37f589814 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:08.692705 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53bad2d0-8314-4149-9234-f7b37f589814 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:08.859063 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-53bad2d0-8314-4149-9234-f7b37f589814 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:08.867569 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-53bad2d0-8314-4149-9234-f7b37f589814 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1358 microversion: 2.1 time: 0.190431 Aug 12 06:54:08.879935 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 372/747] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:08 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:09.149566 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a7bc83a9-e31f-44ce-a56f-8bef7668a289 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:09.150235 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a7bc83a9-e31f-44ce-a56f-8bef7668a289 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:09.160405 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7bc83a9-e31f-44ce-a56f-8bef7668a289 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:09.160906 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7bc83a9-e31f-44ce-a56f-8bef7668a289 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:09.161334 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7bc83a9-e31f-44ce-a56f-8bef7668a289 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:09.162078 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7bc83a9-e31f-44ce-a56f-8bef7668a289 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:09.162485 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7bc83a9-e31f-44ce-a56f-8bef7668a289 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:09.162887 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7bc83a9-e31f-44ce-a56f-8bef7668a289 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:09.177990 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:09.238417 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a7bc83a9-e31f-44ce-a56f-8bef7668a289 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:09.249401 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a7bc83a9-e31f-44ce-a56f-8bef7668a289 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1274 microversion: 2.1 time: 0.103761 Aug 12 06:54:09.249991 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 376/748] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:09 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:09.457794 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:09.458285 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:09.464170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:09.465786 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:09.466498 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:09.466967 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:09.467863 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:09.468501 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:09.469086 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:09.730614 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:09.740518 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:09.742644 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:09.744194 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cf27c36e-ecd0-43d9-8b7a-416695ad2ce9 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1742 microversion: 2.20 time: 0.290360 Aug 12 06:54:09.744871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 373/749] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:09 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1742 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:09.889682 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-380d9901-cd4b-40d6-ac10-859fa2a371d8 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:09.890426 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-380d9901-cd4b-40d6-ac10-859fa2a371d8 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:09.898511 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380d9901-cd4b-40d6-ac10-859fa2a371d8 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:09.899318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380d9901-cd4b-40d6-ac10-859fa2a371d8 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:09.899998 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380d9901-cd4b-40d6-ac10-859fa2a371d8 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:09.901048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380d9901-cd4b-40d6-ac10-859fa2a371d8 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:09.901742 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380d9901-cd4b-40d6-ac10-859fa2a371d8 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:09.902363 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380d9901-cd4b-40d6-ac10-859fa2a371d8 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:10.133461 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-380d9901-cd4b-40d6-ac10-859fa2a371d8 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:10.142761 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-380d9901-cd4b-40d6-ac10-859fa2a371d8 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1549 microversion: 2.1 time: 0.257573 Aug 12 06:54:10.161944 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 377/750] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:09 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1549 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:10.172261 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-abffe9f3-a6e3-4fa7-9af8-14ae15d90799 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:10.173337 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-abffe9f3-a6e3-4fa7-9af8-14ae15d90799 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:10.179613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-abffe9f3-a6e3-4fa7-9af8-14ae15d90799 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:10.180363 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-abffe9f3-a6e3-4fa7-9af8-14ae15d90799 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:10.180968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-abffe9f3-a6e3-4fa7-9af8-14ae15d90799 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:10.181922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-abffe9f3-a6e3-4fa7-9af8-14ae15d90799 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:10.182575 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-abffe9f3-a6e3-4fa7-9af8-14ae15d90799 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:10.183220 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-abffe9f3-a6e3-4fa7-9af8-14ae15d90799 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:10.275505 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-08dd6d50-1226-4f03-bcd4-da1c314ad130 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:10.276151 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-08dd6d50-1226-4f03-bcd4-da1c314ad130 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:10.285400 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08dd6d50-1226-4f03-bcd4-da1c314ad130 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:10.285891 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08dd6d50-1226-4f03-bcd4-da1c314ad130 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:10.286399 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08dd6d50-1226-4f03-bcd4-da1c314ad130 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:10.287888 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08dd6d50-1226-4f03-bcd4-da1c314ad130 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:10.287888 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08dd6d50-1226-4f03-bcd4-da1c314ad130 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:10.288406 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08dd6d50-1226-4f03-bcd4-da1c314ad130 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:10.560101 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-abffe9f3-a6e3-4fa7-9af8-14ae15d90799 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:10.569734 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-abffe9f3-a6e3-4fa7-9af8-14ae15d90799 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1549 microversion: 2.1 time: 0.409438 Aug 12 06:54:10.570314 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 374/751] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:10 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1549 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:10.583690 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-08dd6d50-1226-4f03-bcd4-da1c314ad130 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:10.590457 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e61b6325-b933-48de-8a30-ece049aca6f3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:10.595815 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-08dd6d50-1226-4f03-bcd4-da1c314ad130 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.324676 Aug 12 06:54:10.595979 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e61b6325-b933-48de-8a30-ece049aca6f3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:10.596785 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e61b6325-b933-48de-8a30-ece049aca6f3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Searching by: {'deleted': False, 'project_id': 'a5bda0f141e844dcae39d3a687543744'} {{(pid=127087) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 12 06:54:10.597641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 378/752] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:10 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:10.606741 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e61b6325-b933-48de-8a30-ece049aca6f3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:10.607716 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e61b6325-b933-48de-8a30-ece049aca6f3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:10.608821 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e61b6325-b933-48de-8a30-ece049aca6f3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:10.610004 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e61b6325-b933-48de-8a30-ece049aca6f3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:10.610511 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e61b6325-b933-48de-8a30-ece049aca6f3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:10.611056 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e61b6325-b933-48de-8a30-ece049aca6f3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:10.704744 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.multi_cell_list [None req-e61b6325-b933-48de-8a30-ece049aca6f3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127087) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 12 06:54:10.768908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:10.770575 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:10.776956 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:10.777928 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:10.778086 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:10.778861 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:10.779709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:10.780092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:10.957517 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e61b6325-b933-48de-8a30-ece049aca6f3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.371533 Aug 12 06:54:10.958423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 375/753] 10.222.0.20 () {58 vars in 1125 bytes} [Fri Aug 12 06:54:10 2022] GET /compute/v2.1/servers => generated 342 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:54:10.969083 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-556e89ec-9e72-4e1f-8f19-e3602f2bbb7b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:10.969676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-556e89ec-9e72-4e1f-8f19-e3602f2bbb7b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:10.976241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-556e89ec-9e72-4e1f-8f19-e3602f2bbb7b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:10.976727 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-556e89ec-9e72-4e1f-8f19-e3602f2bbb7b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:10.977183 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-556e89ec-9e72-4e1f-8f19-e3602f2bbb7b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:10.977837 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-556e89ec-9e72-4e1f-8f19-e3602f2bbb7b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:10.978333 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-556e89ec-9e72-4e1f-8f19-e3602f2bbb7b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:10.978941 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-556e89ec-9e72-4e1f-8f19-e3602f2bbb7b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:10.980261 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:10.989366 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:10.991365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:10.992810 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fc1185f2-1d51-4963-b114-5f68446340d4 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1742 microversion: 2.20 time: 0.228178 Aug 12 06:54:10.993482 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 379/754] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:10 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1742 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:11.427735 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-556e89ec-9e72-4e1f-8f19-e3602f2bbb7b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:11.436789 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-556e89ec-9e72-4e1f-8f19-e3602f2bbb7b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1549 microversion: 2.1 time: 0.471347 Aug 12 06:54:11.437608 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 376/755] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:10 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1549 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:11.527450 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-ea5463a7-81bd-400f-a11f-83b2695baa52 req-d27e0cee-a303-4d42-80b9-dde413133580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f2e970-0ac5-4704-a85e-618f53481c54", "tag": "1f839ffa-108f-4ec5-896e-773ddc583a5a"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:11.544078 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ea5463a7-81bd-400f-a11f-83b2695baa52 req-d27e0cee-a303-4d42-80b9-dde413133580 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:11.544638 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ea5463a7-81bd-400f-a11f-83b2695baa52 req-d27e0cee-a303-4d42-80b9-dde413133580 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:11.545068 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ea5463a7-81bd-400f-a11f-83b2695baa52 req-d27e0cee-a303-4d42-80b9-dde413133580 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:11.557775 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-ea5463a7-81bd-400f-a11f-83b2695baa52 req-d27e0cee-a303-4d42-80b9-dde413133580 service nova] Creating event network-changed:1f839ffa-108f-4ec5-896e-773ddc583a5a for instance 99f2e970-0ac5-4704-a85e-618f53481c54 on hv-cinder-84457 Aug 12 06:54:11.562829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-ea5463a7-81bd-400f-a11f-83b2695baa52 req-d27e0cee-a303-4d42-80b9-dde413133580 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041181 Aug 12 06:54:11.565945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 380/756] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:11.617790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-af70a7b5-69e9-4a85-aa6b-06a3f1f15205 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:11.618658 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-af70a7b5-69e9-4a85-aa6b-06a3f1f15205 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:11.625277 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af70a7b5-69e9-4a85-aa6b-06a3f1f15205 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:11.625984 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af70a7b5-69e9-4a85-aa6b-06a3f1f15205 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:11.626559 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af70a7b5-69e9-4a85-aa6b-06a3f1f15205 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:11.627505 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af70a7b5-69e9-4a85-aa6b-06a3f1f15205 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:11.628094 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af70a7b5-69e9-4a85-aa6b-06a3f1f15205 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:11.628659 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af70a7b5-69e9-4a85-aa6b-06a3f1f15205 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:11.865779 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-af70a7b5-69e9-4a85-aa6b-06a3f1f15205 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:11.873949 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-af70a7b5-69e9-4a85-aa6b-06a3f1f15205 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.260045 Aug 12 06:54:11.875091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 377/757] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:11 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:12.022360 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:12.023095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:12.030502 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:12.030993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:12.031417 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:12.032098 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:12.032538 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:12.032952 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:12.163286 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:12.171282 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:12.172729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:12.173871 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-38bdcae1-77a7-4de0-a2c7-d8cbe85d6f54 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1724 microversion: 2.20 time: 0.159578 Aug 12 06:54:12.174439 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 381/758] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:12 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:12.894814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b56daa6d-766d-4d5a-a6bd-0d8784f6ca9b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:12.895481 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b56daa6d-766d-4d5a-a6bd-0d8784f6ca9b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:12.902353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b56daa6d-766d-4d5a-a6bd-0d8784f6ca9b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:12.902767 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b56daa6d-766d-4d5a-a6bd-0d8784f6ca9b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:12.903232 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b56daa6d-766d-4d5a-a6bd-0d8784f6ca9b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:12.903929 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b56daa6d-766d-4d5a-a6bd-0d8784f6ca9b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:12.904386 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b56daa6d-766d-4d5a-a6bd-0d8784f6ca9b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:12.904791 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b56daa6d-766d-4d5a-a6bd-0d8784f6ca9b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:13.038450 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b56daa6d-766d-4d5a-a6bd-0d8784f6ca9b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:13.045916 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b56daa6d-766d-4d5a-a6bd-0d8784f6ca9b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.155391 Aug 12 06:54:13.046471 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 378/759] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:12 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:13.048948 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9b32033a-5637-4d36-903b-855de5267ae1 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cb5089e-da11-48f5-97f4-d56481db484b"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:13.051381 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b32033a-5637-4d36-903b-855de5267ae1 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:13.057870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b32033a-5637-4d36-903b-855de5267ae1 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:13.058343 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b32033a-5637-4d36-903b-855de5267ae1 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:13.058770 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b32033a-5637-4d36-903b-855de5267ae1 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:13.059481 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b32033a-5637-4d36-903b-855de5267ae1 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:13.059931 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b32033a-5637-4d36-903b-855de5267ae1 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:13.060348 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b32033a-5637-4d36-903b-855de5267ae1 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:13.201465 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:13.202439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:13.212403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:13.213425 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:13.214392 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:13.215613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:13.216414 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:13.217117 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:13.350121 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:13.358228 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:13.359748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:13.360900 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-78b793d6-3beb-442c-84c5-1ddc0aace034 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1724 microversion: 2.20 time: 0.166279 Aug 12 06:54:13.361428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 379/760] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:13 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:13.772358 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9b32033a-5637-4d36-903b-855de5267ae1 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "POST /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.727047 Aug 12 06:54:13.773119 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 382/761] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:54:13 2022] POST /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/os-volume_attachments => generated 194 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:14.070796 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-789f4e6f-41bb-4b23-9cfd-879f2d627009 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:14.071761 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-789f4e6f-41bb-4b23-9cfd-879f2d627009 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:14.079733 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-789f4e6f-41bb-4b23-9cfd-879f2d627009 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:14.080221 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-789f4e6f-41bb-4b23-9cfd-879f2d627009 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:14.080650 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-789f4e6f-41bb-4b23-9cfd-879f2d627009 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:14.081344 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-789f4e6f-41bb-4b23-9cfd-879f2d627009 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:14.081793 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-789f4e6f-41bb-4b23-9cfd-879f2d627009 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:14.082253 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-789f4e6f-41bb-4b23-9cfd-879f2d627009 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:14.221258 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-789f4e6f-41bb-4b23-9cfd-879f2d627009 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:14.229293 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-789f4e6f-41bb-4b23-9cfd-879f2d627009 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.165071 Aug 12 06:54:14.229849 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 380/762] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:14 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:14.389822 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:14.390833 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:14.402315 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:14.402814 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:14.403273 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:14.403950 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:14.404396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:14.404804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:14.540180 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:14.548583 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:14.550074 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:14.551276 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-713d4adb-c3ee-4f23-bbd0-bda3947ccccb tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1724 microversion: 2.20 time: 0.168847 Aug 12 06:54:14.551843 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 383/763] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:14 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:14.877382 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-1812aa9e-f2f2-4c8a-bb10-1dc67529e463 req-1e2ed5ba-cc19-487e-b450-f0cb293601fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0893bde6-8eaf-4ca0-95bb-0c04c57e158e", "name": "network-vif-unplugged", "status": "completed", "tag": "4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:14.889249 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1812aa9e-f2f2-4c8a-bb10-1dc67529e463 req-1e2ed5ba-cc19-487e-b450-f0cb293601fe service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:14.889793 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1812aa9e-f2f2-4c8a-bb10-1dc67529e463 req-1e2ed5ba-cc19-487e-b450-f0cb293601fe service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:14.890323 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1812aa9e-f2f2-4c8a-bb10-1dc67529e463 req-1e2ed5ba-cc19-487e-b450-f0cb293601fe service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:14.909689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-1812aa9e-f2f2-4c8a-bb10-1dc67529e463 req-1e2ed5ba-cc19-487e-b450-f0cb293601fe service nova] Creating event network-vif-unplugged:4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc for instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e on hv-cinder-84457 Aug 12 06:54:14.914947 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-1812aa9e-f2f2-4c8a-bb10-1dc67529e463 req-1e2ed5ba-cc19-487e-b450-f0cb293601fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045939 Aug 12 06:54:14.915580 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 381/764] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:15.250027 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5ff5e63d-91ba-492c-b1b1-381ee94aadfd tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:15.251138 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5ff5e63d-91ba-492c-b1b1-381ee94aadfd tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:15.258346 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ff5e63d-91ba-492c-b1b1-381ee94aadfd tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:15.258828 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ff5e63d-91ba-492c-b1b1-381ee94aadfd tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:15.259302 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ff5e63d-91ba-492c-b1b1-381ee94aadfd tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:15.259957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ff5e63d-91ba-492c-b1b1-381ee94aadfd tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:15.261049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ff5e63d-91ba-492c-b1b1-381ee94aadfd tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:15.261598 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ff5e63d-91ba-492c-b1b1-381ee94aadfd tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:15.480764 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5ff5e63d-91ba-492c-b1b1-381ee94aadfd tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:15.488548 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5ff5e63d-91ba-492c-b1b1-381ee94aadfd tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.242267 Aug 12 06:54:15.489215 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 384/765] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:15 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:15.574602 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:15.575427 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:15.582603 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:15.583106 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:15.583529 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:15.584218 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:15.584669 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:15.585079 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:15.717591 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:15.725710 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:15.727224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:15.728420 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e5435a02-4074-4bd8-bc73-93ff92a6e3e8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1667 microversion: 2.20 time: 0.158219 Aug 12 06:54:15.728916 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 382/766] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:15 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:15.751328 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9a11cd6a-b8ec-48d7-8bf3-b6e7665d83fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b032811-486f-4f8b-af2c-5a9e02edb4d3"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:15.753737 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9a11cd6a-b8ec-48d7-8bf3-b6e7665d83fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:15.760125 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a11cd6a-b8ec-48d7-8bf3-b6e7665d83fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:15.760610 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a11cd6a-b8ec-48d7-8bf3-b6e7665d83fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:15.761038 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a11cd6a-b8ec-48d7-8bf3-b6e7665d83fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:15.761726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a11cd6a-b8ec-48d7-8bf3-b6e7665d83fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:15.762175 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a11cd6a-b8ec-48d7-8bf3-b6e7665d83fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:15.762590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a11cd6a-b8ec-48d7-8bf3-b6e7665d83fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:16.204100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9a11cd6a-b8ec-48d7-8bf3-b6e7665d83fe tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "POST /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.456793 Aug 12 06:54:16.204695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 385/767] 10.222.0.20 () {62 vars in 1364 bytes} [Fri Aug 12 06:54:15 2022] POST /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/os-volume_attachments => generated 188 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 06:54:16.327920 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3ac46383-e8d0-4c6a-936c-d8ab1943f730 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:16.328400 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3ac46383-e8d0-4c6a-936c-d8ab1943f730 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:16.334724 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ac46383-e8d0-4c6a-936c-d8ab1943f730 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:16.335246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ac46383-e8d0-4c6a-936c-d8ab1943f730 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:16.335678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ac46383-e8d0-4c6a-936c-d8ab1943f730 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:16.336360 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ac46383-e8d0-4c6a-936c-d8ab1943f730 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:16.336805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ac46383-e8d0-4c6a-936c-d8ab1943f730 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:16.337221 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ac46383-e8d0-4c6a-936c-d8ab1943f730 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:16.509712 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6727119c-b204-40bc-b0b4-89297841949f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:16.510290 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6727119c-b204-40bc-b0b4-89297841949f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:16.517510 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6727119c-b204-40bc-b0b4-89297841949f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:16.518003 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6727119c-b204-40bc-b0b4-89297841949f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:16.518750 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6727119c-b204-40bc-b0b4-89297841949f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:16.519482 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6727119c-b204-40bc-b0b4-89297841949f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:16.519930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6727119c-b204-40bc-b0b4-89297841949f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:16.520357 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6727119c-b204-40bc-b0b4-89297841949f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:16.588028 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3ac46383-e8d0-4c6a-936c-d8ab1943f730 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/os-volume_attachments/7b032811-486f-4f8b-af2c-5a9e02edb4d3" status: 202 len: 0 microversion: 2.20 time: 0.264127 Aug 12 06:54:16.589344 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 383/768] 10.222.0.20 () {60 vars in 1457 bytes} [Fri Aug 12 06:54:16 2022] DELETE /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/os-volume_attachments/7b032811-486f-4f8b-af2c-5a9e02edb4d3 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:54:16.648979 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-43204eb2-45ef-4f87-86eb-926af2671641 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:16.649588 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-43204eb2-45ef-4f87-86eb-926af2671641 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:16.656268 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6727119c-b204-40bc-b0b4-89297841949f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:16.656438 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-43204eb2-45ef-4f87-86eb-926af2671641 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:16.656840 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-43204eb2-45ef-4f87-86eb-926af2671641 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:16.657271 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-43204eb2-45ef-4f87-86eb-926af2671641 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:16.657964 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-43204eb2-45ef-4f87-86eb-926af2671641 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:16.658415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-43204eb2-45ef-4f87-86eb-926af2671641 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:16.658835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-43204eb2-45ef-4f87-86eb-926af2671641 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:16.664360 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6727119c-b204-40bc-b0b4-89297841949f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.158489 Aug 12 06:54:16.664982 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 386/769] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:16 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:16.702462 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-43204eb2-45ef-4f87-86eb-926af2671641 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127087) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 06:54:16.772660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-43204eb2-45ef-4f87-86eb-926af2671641 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "POST /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/action" status: 202 len: 0 microversion: 2.20 time: 0.127599 Aug 12 06:54:16.776295 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 384/770] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Aug 12 06:54:16 2022] POST /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 12 06:54:16.781877 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:16.782535 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:16.795675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:16.796196 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:16.796666 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:16.797366 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:16.797902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:16.798251 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:16.814699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:16.943688 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:16.951804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:16.953285 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:16.954428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ca6598e4-f1ef-4aca-b40b-7957ebd31581 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1675 microversion: 2.20 time: 0.176763 Aug 12 06:54:16.955009 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 387/771] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:16 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:17.685875 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-eb899b18-5757-4a2a-b964-8da595f360c9 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:17.686464 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-eb899b18-5757-4a2a-b964-8da595f360c9 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:17.692822 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb899b18-5757-4a2a-b964-8da595f360c9 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:17.693298 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb899b18-5757-4a2a-b964-8da595f360c9 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:17.693719 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb899b18-5757-4a2a-b964-8da595f360c9 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:17.694401 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb899b18-5757-4a2a-b964-8da595f360c9 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:17.694852 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb899b18-5757-4a2a-b964-8da595f360c9 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:17.695312 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eb899b18-5757-4a2a-b964-8da595f360c9 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:17.699647 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:17.848399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-eb899b18-5757-4a2a-b964-8da595f360c9 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:17.856120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-eb899b18-5757-4a2a-b964-8da595f360c9 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.174787 Aug 12 06:54:17.856683 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 385/772] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:17 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:17.978075 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:17.978646 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:17.980589 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=8 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:17.981745 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:17.988460 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:17.988951 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:17.989377 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:17.990076 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:17.990520 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:17.990930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:18.127221 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:18.135273 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:18.136754 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:18.137913 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bc4afe2a-a88c-475c-9bff-01c1ff3a4c58 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1677 microversion: 2.20 time: 0.163784 Aug 12 06:54:18.138487 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 388/773] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:17 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:18.561761 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3539e56f-7ee0-43b4-8a68-67a74ced1395 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:18.562215 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3539e56f-7ee0-43b4-8a68-67a74ced1395 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:18.568722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3539e56f-7ee0-43b4-8a68-67a74ced1395 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:18.569203 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3539e56f-7ee0-43b4-8a68-67a74ced1395 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:18.569642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3539e56f-7ee0-43b4-8a68-67a74ced1395 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:18.570337 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3539e56f-7ee0-43b4-8a68-67a74ced1395 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:18.570792 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3539e56f-7ee0-43b4-8a68-67a74ced1395 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:18.571250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3539e56f-7ee0-43b4-8a68-67a74ced1395 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:18.594799 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3539e56f-7ee0-43b4-8a68-67a74ced1395 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/ips" status: 200 len: 147 microversion: 2.1 time: 0.037140 Aug 12 06:54:18.595768 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 386/774] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 06:54:18 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:18.885614 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-fa112086-9753-4ba8-9d57-ea2e84e9377c req-19b62a3f-2a20-4e61-8540-21eda31eb5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f2e970-0ac5-4704-a85e-618f53481c54", "name": "network-vif-plugged", "status": "completed", "tag": "1f839ffa-108f-4ec5-896e-773ddc583a5a"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:18.887002 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5cd06539-46a0-4e5f-8094-ef00fc4cdb6e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:18.889472 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5cd06539-46a0-4e5f-8094-ef00fc4cdb6e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:18.915688 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5cd06539-46a0-4e5f-8094-ef00fc4cdb6e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:18.919756 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fa112086-9753-4ba8-9d57-ea2e84e9377c req-19b62a3f-2a20-4e61-8540-21eda31eb5e7 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:18.920232 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fa112086-9753-4ba8-9d57-ea2e84e9377c req-19b62a3f-2a20-4e61-8540-21eda31eb5e7 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:18.920927 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5cd06539-46a0-4e5f-8094-ef00fc4cdb6e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:18.921424 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5cd06539-46a0-4e5f-8094-ef00fc4cdb6e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:18.922170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5cd06539-46a0-4e5f-8094-ef00fc4cdb6e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:18.922615 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5cd06539-46a0-4e5f-8094-ef00fc4cdb6e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:18.923057 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5cd06539-46a0-4e5f-8094-ef00fc4cdb6e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:18.926530 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fa112086-9753-4ba8-9d57-ea2e84e9377c req-19b62a3f-2a20-4e61-8540-21eda31eb5e7 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:18.950279 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-fa112086-9753-4ba8-9d57-ea2e84e9377c req-19b62a3f-2a20-4e61-8540-21eda31eb5e7 service nova] Creating event network-vif-plugged:1f839ffa-108f-4ec5-896e-773ddc583a5a for instance 99f2e970-0ac5-4704-a85e-618f53481c54 on hv-cinder-84457 Aug 12 06:54:18.956135 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-fa112086-9753-4ba8-9d57-ea2e84e9377c req-19b62a3f-2a20-4e61-8540-21eda31eb5e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080234 Aug 12 06:54:18.957061 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 389/775] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:19.094726 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5cd06539-46a0-4e5f-8094-ef00fc4cdb6e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:19.107154 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5cd06539-46a0-4e5f-8094-ef00fc4cdb6e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.230431 Aug 12 06:54:19.107743 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 387/776] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:18 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:19.162171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:19.162852 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:19.169183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:19.169597 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:19.170018 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:19.170700 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:19.171177 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:19.171592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:19.187812 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:19.371327 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:19.381728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:19.383673 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:19.384985 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3b878269-5d3e-4fb4-9f2f-846538a73c6c tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.227570 Aug 12 06:54:19.385701 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 390/777] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:19 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:54:19.973894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4d5aac5c-98f9-40d8-b3c4-f40b786a0f82 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8052471e-7bc7-48c2-b352-963f2580fc0a"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:19.976455 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4d5aac5c-98f9-40d8-b3c4-f40b786a0f82 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:19.983375 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d5aac5c-98f9-40d8-b3c4-f40b786a0f82 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:19.983857 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d5aac5c-98f9-40d8-b3c4-f40b786a0f82 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:19.984287 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d5aac5c-98f9-40d8-b3c4-f40b786a0f82 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:19.984982 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d5aac5c-98f9-40d8-b3c4-f40b786a0f82 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:19.985429 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d5aac5c-98f9-40d8-b3c4-f40b786a0f82 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:19.985848 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d5aac5c-98f9-40d8-b3c4-f40b786a0f82 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:20.128530 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b31fa1f0-de91-4181-9374-c5e7a10eb143 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:20.129174 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b31fa1f0-de91-4181-9374-c5e7a10eb143 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:20.135751 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b31fa1f0-de91-4181-9374-c5e7a10eb143 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:20.136393 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b31fa1f0-de91-4181-9374-c5e7a10eb143 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:20.136816 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b31fa1f0-de91-4181-9374-c5e7a10eb143 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:20.137556 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b31fa1f0-de91-4181-9374-c5e7a10eb143 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:20.138008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b31fa1f0-de91-4181-9374-c5e7a10eb143 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:20.138414 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b31fa1f0-de91-4181-9374-c5e7a10eb143 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:20.283493 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b31fa1f0-de91-4181-9374-c5e7a10eb143 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:20.292575 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b31fa1f0-de91-4181-9374-c5e7a10eb143 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.167945 Aug 12 06:54:20.293277 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 391/778] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:20 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:20.408990 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:20.409590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:20.415853 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:20.416388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:20.416826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:20.417531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:20.418169 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:20.418587 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:20.564638 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:20.573117 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:20.574752 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:20.575942 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-83ab3033-7a47-4fab-8ce5-8a3374d92472 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.171124 Aug 12 06:54:20.576622 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 392/779] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:20 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:20.645063 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:21.314644 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8b8beaa7-19b0-4796-b9f4-8ea196e6bd67 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:21.315978 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8b8beaa7-19b0-4796-b9f4-8ea196e6bd67 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:21.323420 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b8beaa7-19b0-4796-b9f4-8ea196e6bd67 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:21.324039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b8beaa7-19b0-4796-b9f4-8ea196e6bd67 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:21.324464 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b8beaa7-19b0-4796-b9f4-8ea196e6bd67 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:21.325157 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b8beaa7-19b0-4796-b9f4-8ea196e6bd67 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:21.325601 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b8beaa7-19b0-4796-b9f4-8ea196e6bd67 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:21.326008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b8beaa7-19b0-4796-b9f4-8ea196e6bd67 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:21.463714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8b8beaa7-19b0-4796-b9f4-8ea196e6bd67 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:21.471860 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8b8beaa7-19b0-4796-b9f4-8ea196e6bd67 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.161546 Aug 12 06:54:21.472438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 393/780] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:21 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:21.601213 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:21.602535 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:21.610379 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:21.610880 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:21.611446 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:21.612187 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:21.612641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:21.613059 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:21.748061 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:21.756496 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:21.757998 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:21.759221 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-af212632-314b-4615-8dc3-1b761c6fcdef tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.163347 Aug 12 06:54:21.759997 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 394/781] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:21 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:22.493522 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-19d5819e-083d-4b3b-a961-be45e6106fa0 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:22.494241 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-19d5819e-083d-4b3b-a961-be45e6106fa0 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:22.502449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19d5819e-083d-4b3b-a961-be45e6106fa0 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:22.503225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19d5819e-083d-4b3b-a961-be45e6106fa0 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:22.503806 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19d5819e-083d-4b3b-a961-be45e6106fa0 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:22.504751 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19d5819e-083d-4b3b-a961-be45e6106fa0 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:22.505197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19d5819e-083d-4b3b-a961-be45e6106fa0 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:22.505610 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19d5819e-083d-4b3b-a961-be45e6106fa0 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:22.649150 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-19d5819e-083d-4b3b-a961-be45e6106fa0 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:22.657018 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-19d5819e-083d-4b3b-a961-be45e6106fa0 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.167891 Aug 12 06:54:22.657553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 395/782] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:22 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:22.783050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:22.783679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:22.789990 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:22.790461 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:22.790886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:22.791589 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:22.792027 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:22.792436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:22.942252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:22.950326 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:22.951849 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:22.953003 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bdb74392-09f7-4399-bde6-bb57bdd4dcf8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.174045 Aug 12 06:54:22.953543 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 396/783] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:22 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:54:23.682620 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8c633c26-5f0f-4c2e-8585-390f35bb1c0f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:23.683767 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8c633c26-5f0f-4c2e-8585-390f35bb1c0f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:23.694639 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c633c26-5f0f-4c2e-8585-390f35bb1c0f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:23.695553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c633c26-5f0f-4c2e-8585-390f35bb1c0f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:23.696300 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c633c26-5f0f-4c2e-8585-390f35bb1c0f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:23.697410 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c633c26-5f0f-4c2e-8585-390f35bb1c0f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:23.698211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c633c26-5f0f-4c2e-8585-390f35bb1c0f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:23.698904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c633c26-5f0f-4c2e-8585-390f35bb1c0f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:23.845097 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8c633c26-5f0f-4c2e-8585-390f35bb1c0f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:23.852944 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8c633c26-5f0f-4c2e-8585-390f35bb1c0f tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.176986 Aug 12 06:54:23.853710 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 397/784] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:23 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:23.981645 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:23.982492 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:23.992569 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:23.993343 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:23.994088 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:23.995251 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:23.996175 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:23.996910 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:24.151125 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:24.160890 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:24.162597 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:24.164009 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ff80d6e9-06fa-41c0-a231-69d38d4c2ace tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.189496 Aug 12 06:54:24.164583 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 398/785] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:23 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:24.874073 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7842c275-3568-4afe-b2bb-a47f5ae34917 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:24.874885 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7842c275-3568-4afe-b2bb-a47f5ae34917 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:24.881464 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7842c275-3568-4afe-b2bb-a47f5ae34917 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:24.881943 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7842c275-3568-4afe-b2bb-a47f5ae34917 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:24.882409 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7842c275-3568-4afe-b2bb-a47f5ae34917 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:24.883187 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7842c275-3568-4afe-b2bb-a47f5ae34917 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:24.883639 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7842c275-3568-4afe-b2bb-a47f5ae34917 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:24.884053 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7842c275-3568-4afe-b2bb-a47f5ae34917 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:25.021849 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7842c275-3568-4afe-b2bb-a47f5ae34917 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:25.029483 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7842c275-3568-4afe-b2bb-a47f5ae34917 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.159571 Aug 12 06:54:25.030045 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 399/786] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:24 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:25.188847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:25.189452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:25.195656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:25.196137 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:25.196569 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:25.197281 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:25.197693 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:25.198122 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:25.340804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:25.349504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:25.351036 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:25.362597 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ef2aae32-c46e-4686-91d3-2be5dd3d2e7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.167370 Aug 12 06:54:25.363315 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 400/787] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:25 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:54:26.051592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d2668bfe-b70f-403c-93b6-fe8af8e387d1 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:26.052353 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d2668bfe-b70f-403c-93b6-fe8af8e387d1 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:26.059304 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2668bfe-b70f-403c-93b6-fe8af8e387d1 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:26.059781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2668bfe-b70f-403c-93b6-fe8af8e387d1 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:26.060203 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2668bfe-b70f-403c-93b6-fe8af8e387d1 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:26.060916 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2668bfe-b70f-403c-93b6-fe8af8e387d1 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:26.061366 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2668bfe-b70f-403c-93b6-fe8af8e387d1 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:26.061778 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2668bfe-b70f-403c-93b6-fe8af8e387d1 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:26.205716 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d2668bfe-b70f-403c-93b6-fe8af8e387d1 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:26.213947 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d2668bfe-b70f-403c-93b6-fe8af8e387d1 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.166302 Aug 12 06:54:26.214766 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 401/788] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:26 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:26.388951 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:26.389504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:26.396325 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:26.397661 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:26.397661 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:26.409129 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:26.410739 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:26.411981 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:26.553367 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:26.569391 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:26.570871 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:26.572063 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6bcc2b6b-673c-4ef5-b572-02f9aceae40f tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.188011 Aug 12 06:54:26.572624 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 402/789] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:26 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:54:27.239347 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c6e6e0bc-4568-45e5-8371-33d7061969bf tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:27.240146 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c6e6e0bc-4568-45e5-8371-33d7061969bf tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:27.247675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6e6e0bc-4568-45e5-8371-33d7061969bf tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:27.248174 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6e6e0bc-4568-45e5-8371-33d7061969bf tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:27.248580 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6e6e0bc-4568-45e5-8371-33d7061969bf tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:27.249322 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6e6e0bc-4568-45e5-8371-33d7061969bf tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:27.249776 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6e6e0bc-4568-45e5-8371-33d7061969bf tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:27.250196 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6e6e0bc-4568-45e5-8371-33d7061969bf tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:27.390991 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c6e6e0bc-4568-45e5-8371-33d7061969bf tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:27.398847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c6e6e0bc-4568-45e5-8371-33d7061969bf tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.166612 Aug 12 06:54:27.399446 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 403/790] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:27 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:27.597484 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:27.598408 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:27.605037 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:27.605598 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:27.606151 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:27.606995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:27.607522 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:27.608000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:27.772543 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:27.781628 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:27.783146 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:27.784318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0b041df8-d910-4964-b7f4-baf06194525b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.191995 Aug 12 06:54:27.784888 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 404/791] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:27 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:28.420134 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-35ce3c1c-4a0f-45d5-9ab7-2af27cc22e37 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:28.420833 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-35ce3c1c-4a0f-45d5-9ab7-2af27cc22e37 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:28.427386 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35ce3c1c-4a0f-45d5-9ab7-2af27cc22e37 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:28.429041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35ce3c1c-4a0f-45d5-9ab7-2af27cc22e37 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:28.429668 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35ce3c1c-4a0f-45d5-9ab7-2af27cc22e37 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:28.430632 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35ce3c1c-4a0f-45d5-9ab7-2af27cc22e37 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:28.431113 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35ce3c1c-4a0f-45d5-9ab7-2af27cc22e37 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:28.431537 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35ce3c1c-4a0f-45d5-9ab7-2af27cc22e37 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:28.597538 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-35ce3c1c-4a0f-45d5-9ab7-2af27cc22e37 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:28.605896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-35ce3c1c-4a0f-45d5-9ab7-2af27cc22e37 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.190705 Aug 12 06:54:28.611950 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 405/792] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:28 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:28.809691 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:28.810576 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:28.817031 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:28.817507 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:28.818055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:28.818951 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:28.819532 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:28.819968 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:28.955228 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:28.963450 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:28.964966 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:28.966123 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-69e919cc-bca5-4506-9303-68f2b1265447 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.162468 Aug 12 06:54:28.966677 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 406/793] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:28 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:29.634854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f049d6ab-782a-4bda-a53a-34a5a4bd3fdb tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:29.635904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f049d6ab-782a-4bda-a53a-34a5a4bd3fdb tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:29.643904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f049d6ab-782a-4bda-a53a-34a5a4bd3fdb tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:29.644374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f049d6ab-782a-4bda-a53a-34a5a4bd3fdb tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:29.644804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f049d6ab-782a-4bda-a53a-34a5a4bd3fdb tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:29.645484 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f049d6ab-782a-4bda-a53a-34a5a4bd3fdb tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:29.645927 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f049d6ab-782a-4bda-a53a-34a5a4bd3fdb tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:29.646329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f049d6ab-782a-4bda-a53a-34a5a4bd3fdb tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:29.648918 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:29.778234 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f049d6ab-782a-4bda-a53a-34a5a4bd3fdb tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:29.786181 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f049d6ab-782a-4bda-a53a-34a5a4bd3fdb tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1314 microversion: 2.1 time: 0.157681 Aug 12 06:54:29.786749 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 407/794] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:29 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:29.981141 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:29.996864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:29.998043 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:30.004339 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:30.004810 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:30.005230 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:30.005908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:30.006349 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:30.006764 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:30.071351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=20 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:30.139006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:30.147987 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:30.149459 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:30.150600 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e7c2f3ad-b561-460c-839d-4acdf1801436 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.163864 Aug 12 06:54:30.151196 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 408/795] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:29 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:30.814345 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-471d2506-5fb1-4d51-b8ea-ec2d7cf8b911 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:30.815430 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-471d2506-5fb1-4d51-b8ea-ec2d7cf8b911 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:30.825655 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-471d2506-5fb1-4d51-b8ea-ec2d7cf8b911 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:30.826459 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-471d2506-5fb1-4d51-b8ea-ec2d7cf8b911 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:30.827219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-471d2506-5fb1-4d51-b8ea-ec2d7cf8b911 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:30.828328 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-471d2506-5fb1-4d51-b8ea-ec2d7cf8b911 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:30.829109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-471d2506-5fb1-4d51-b8ea-ec2d7cf8b911 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:30.829787 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-471d2506-5fb1-4d51-b8ea-ec2d7cf8b911 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:30.966955 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-471d2506-5fb1-4d51-b8ea-ec2d7cf8b911 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:30.969902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4d5aac5c-98f9-40d8-b3c4-f40b786a0f82 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "POST /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.000057 Aug 12 06:54:30.970747 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 388/796] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:54:19 2022] POST /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments => generated 194 bytes in 11002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:54:30.974482 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-471d2506-5fb1-4d51-b8ea-ec2d7cf8b911 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1498 microversion: 2.1 time: 0.166809 Aug 12 06:54:30.975024 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 409/797] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:30 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:31.175235 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:31.175841 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:31.182659 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:31.183179 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:31.183616 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:31.184339 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:31.184789 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:31.185213 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:31.321159 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:31.329464 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:31.330944 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:31.332156 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3a26b651-8374-4703-bfcc-613a78a8a0c8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.161911 Aug 12 06:54:31.332712 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 389/798] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:31 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:31.513317 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f1cd943b-c5e0-414c-bf9b-cbda79cea110 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:31.513808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f1cd943b-c5e0-414c-bf9b-cbda79cea110 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:31.520599 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1cd943b-c5e0-414c-bf9b-cbda79cea110 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:31.521084 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1cd943b-c5e0-414c-bf9b-cbda79cea110 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:31.521517 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1cd943b-c5e0-414c-bf9b-cbda79cea110 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:31.522205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1cd943b-c5e0-414c-bf9b-cbda79cea110 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:31.522656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1cd943b-c5e0-414c-bf9b-cbda79cea110 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:31.523107 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f1cd943b-c5e0-414c-bf9b-cbda79cea110 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:31.547631 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f1cd943b-c5e0-414c-bf9b-cbda79cea110 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:54:31.626691 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f1cd943b-c5e0-414c-bf9b-cbda79cea110 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "DELETE /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 204 len: 0 microversion: 2.1 time: 0.116866 Aug 12 06:54:31.627292 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 410/799] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:54:31 2022] DELETE /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:54:31.635873 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-568ead08-988a-4ed3-8947-ddb1aff532b4 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:31.636471 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-568ead08-988a-4ed3-8947-ddb1aff532b4 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:31.642813 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-568ead08-988a-4ed3-8947-ddb1aff532b4 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:31.643619 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-568ead08-988a-4ed3-8947-ddb1aff532b4 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:31.644047 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-568ead08-988a-4ed3-8947-ddb1aff532b4 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:31.644722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-568ead08-988a-4ed3-8947-ddb1aff532b4 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:31.645190 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-568ead08-988a-4ed3-8947-ddb1aff532b4 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:31.645578 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-568ead08-988a-4ed3-8947-ddb1aff532b4 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:31.786833 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-568ead08-988a-4ed3-8947-ddb1aff532b4 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:31.795196 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-568ead08-988a-4ed3-8947-ddb1aff532b4 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1504 microversion: 2.1 time: 0.163183 Aug 12 06:54:31.795819 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 390/800] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:31 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:32.116138 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cf661cac-731e-4e99-b9f0-45f8b94a8ca7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:32.117591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cf661cac-731e-4e99-b9f0-45f8b94a8ca7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:32.124476 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf661cac-731e-4e99-b9f0-45f8b94a8ca7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:32.124975 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf661cac-731e-4e99-b9f0-45f8b94a8ca7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:32.125406 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf661cac-731e-4e99-b9f0-45f8b94a8ca7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:32.126117 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf661cac-731e-4e99-b9f0-45f8b94a8ca7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:32.126563 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf661cac-731e-4e99-b9f0-45f8b94a8ca7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:32.126995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf661cac-731e-4e99-b9f0-45f8b94a8ca7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:32.150994 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cf661cac-731e-4e99-b9f0-45f8b94a8ca7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/ips" status: 200 len: 149 microversion: 2.1 time: 0.039910 Aug 12 06:54:32.151577 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 411/801] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 06:54:32 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:32.354716 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:32.355369 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:32.362056 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:32.362652 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:32.363165 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:32.363908 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:32.364354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:32.364767 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:32.508971 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:32.517474 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:32.519335 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:32.520559 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-df4e3476-c2ed-4209-ba49-7244c205f30a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.169793 Aug 12 06:54:32.521181 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 391/802] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:32 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:32.815906 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b872be49-a900-4d94-8ab8-c2c51721ce81 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:32.816503 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b872be49-a900-4d94-8ab8-c2c51721ce81 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:32.822810 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b872be49-a900-4d94-8ab8-c2c51721ce81 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:32.823327 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b872be49-a900-4d94-8ab8-c2c51721ce81 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:32.823756 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b872be49-a900-4d94-8ab8-c2c51721ce81 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:32.824445 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b872be49-a900-4d94-8ab8-c2c51721ce81 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:32.824894 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b872be49-a900-4d94-8ab8-c2c51721ce81 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:32.825316 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b872be49-a900-4d94-8ab8-c2c51721ce81 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:32.957064 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b872be49-a900-4d94-8ab8-c2c51721ce81 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:32.965990 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b872be49-a900-4d94-8ab8-c2c51721ce81 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1504 microversion: 2.1 time: 0.153929 Aug 12 06:54:32.967143 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 412/803] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:32 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:33.500648 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7556be70-80cf-47a4-83ed-f7e1d094e9c3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af10f280-0bab-413f-8a15-461d4ba1818d"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:33.503143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7556be70-80cf-47a4-83ed-f7e1d094e9c3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:33.509574 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7556be70-80cf-47a4-83ed-f7e1d094e9c3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:33.510058 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7556be70-80cf-47a4-83ed-f7e1d094e9c3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:33.510461 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7556be70-80cf-47a4-83ed-f7e1d094e9c3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:33.511214 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7556be70-80cf-47a4-83ed-f7e1d094e9c3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:33.511667 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7556be70-80cf-47a4-83ed-f7e1d094e9c3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:33.512084 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7556be70-80cf-47a4-83ed-f7e1d094e9c3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:33.549772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:33.550287 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:33.556717 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:33.557195 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:33.557625 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:33.558312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:33.558758 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:33.559216 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:33.693352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:33.704264 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:33.705779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:33.707329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ce024a17-ba7a-41e2-9227-7d80cd97077e tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.161242 Aug 12 06:54:33.708149 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 413/804] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:33 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:33.952240 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7556be70-80cf-47a4-83ed-f7e1d094e9c3 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "POST /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.455263 Aug 12 06:54:33.952829 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 392/805] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:54:33 2022] POST /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments => generated 194 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:33.987238 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-89224317-d786-49e8-9c8e-6a291246bf1b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:33.987830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-89224317-d786-49e8-9c8e-6a291246bf1b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:33.993729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89224317-d786-49e8-9c8e-6a291246bf1b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:33.994421 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89224317-d786-49e8-9c8e-6a291246bf1b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:33.994895 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89224317-d786-49e8-9c8e-6a291246bf1b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:33.995612 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89224317-d786-49e8-9c8e-6a291246bf1b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:33.996055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89224317-d786-49e8-9c8e-6a291246bf1b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:33.996466 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89224317-d786-49e8-9c8e-6a291246bf1b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:34.215114 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89224317-d786-49e8-9c8e-6a291246bf1b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:34.220441 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-89224317-d786-49e8-9c8e-6a291246bf1b tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 200 len: 1504 microversion: 2.1 time: 0.236900 Aug 12 06:54:34.221120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 414/806] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:33 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:34.283850 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fcb71108-6796-4802-a113-8974b25e36d4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:34.284548 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fcb71108-6796-4802-a113-8974b25e36d4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:34.291194 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fcb71108-6796-4802-a113-8974b25e36d4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:34.291766 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fcb71108-6796-4802-a113-8974b25e36d4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:34.292164 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fcb71108-6796-4802-a113-8974b25e36d4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:34.292874 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fcb71108-6796-4802-a113-8974b25e36d4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:34.293320 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fcb71108-6796-4802-a113-8974b25e36d4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:34.293739 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fcb71108-6796-4802-a113-8974b25e36d4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:34.410914 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-083d949b-b752-40ed-b30e-60acfda3e021 req-5bc0806f-7169-4261-8c8f-c73f7eab9f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f2e970-0ac5-4704-a85e-618f53481c54", "name": "network-vif-deleted", "tag": "1f839ffa-108f-4ec5-896e-773ddc583a5a"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:34.422285 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-083d949b-b752-40ed-b30e-60acfda3e021 req-5bc0806f-7169-4261-8c8f-c73f7eab9f6a service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:34.422757 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-083d949b-b752-40ed-b30e-60acfda3e021 req-5bc0806f-7169-4261-8c8f-c73f7eab9f6a service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:34.423199 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-083d949b-b752-40ed-b30e-60acfda3e021 req-5bc0806f-7169-4261-8c8f-c73f7eab9f6a service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:34.448512 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-083d949b-b752-40ed-b30e-60acfda3e021 req-5bc0806f-7169-4261-8c8f-c73f7eab9f6a service nova] Creating event network-vif-deleted:1f839ffa-108f-4ec5-896e-773ddc583a5a for instance 99f2e970-0ac5-4704-a85e-618f53481c54 on hv-cinder-84457 Aug 12 06:54:34.453723 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-083d949b-b752-40ed-b30e-60acfda3e021 req-5bc0806f-7169-4261-8c8f-c73f7eab9f6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046821 Aug 12 06:54:34.454326 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 415/807] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:34.470950 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fcb71108-6796-4802-a113-8974b25e36d4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:34.479015 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fcb71108-6796-4802-a113-8974b25e36d4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1595 microversion: 2.1 time: 0.199962 Aug 12 06:54:34.479580 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 393/808] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:34 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1595 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:34.731923 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:34.732773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:34.739794 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:34.740299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:34.740732 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:34.741421 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:34.741872 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:34.742287 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:34.884198 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:34.894025 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:34.895993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:34.897460 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8cfacd4e-7269-44f4-984d-d8d64eb7164d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.170164 Aug 12 06:54:34.898481 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 416/809] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:34 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:34.989431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-905335ab-3cb3-4bd0-b558-d0555a0a2d13 req-2c840b8b-8896-440f-bfc2-96c3e68cad9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0893bde6-8eaf-4ca0-95bb-0c04c57e158e", "name": "network-vif-plugged", "status": "completed", "tag": "4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:35.005607 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-905335ab-3cb3-4bd0-b558-d0555a0a2d13 req-2c840b8b-8896-440f-bfc2-96c3e68cad9c service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:35.007105 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-905335ab-3cb3-4bd0-b558-d0555a0a2d13 req-2c840b8b-8896-440f-bfc2-96c3e68cad9c service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:35.010054 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-905335ab-3cb3-4bd0-b558-d0555a0a2d13 req-2c840b8b-8896-440f-bfc2-96c3e68cad9c service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:35.030805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-905335ab-3cb3-4bd0-b558-d0555a0a2d13 req-2c840b8b-8896-440f-bfc2-96c3e68cad9c service nova] Creating event network-vif-plugged:4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc for instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e on hv-cinder-84457 Aug 12 06:54:35.036164 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-905335ab-3cb3-4bd0-b558-d0555a0a2d13 req-2c840b8b-8896-440f-bfc2-96c3e68cad9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051847 Aug 12 06:54:35.037292 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 394/810] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:35.242881 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:35.243528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 99f2e970-0ac5-4704-a85e-618f53481c54] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:35.250285 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:35.250747 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:35.251205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:35.252149 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:35.252601 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:35.253018 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:35.272019 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] HTTP exception thrown: Instance 99f2e970-0ac5-4704-a85e-618f53481c54 could not be found. Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Request method failure captured: Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 HTTP/1.1 Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9fkM8vtXS8CFvGTfnQuhks4I_m9Gj1dlQl5o8q_mwFoAtukm93aFqGVSffgiVKEhb7YnHOkMeyCFVkiE1I4TjxBU0X22oJPqynemwqby3sh4XntPSGD0SPzDpCW7sO0igFB5NDr4eOrd-9jbHJJRPR_e-Uibo4Z32WljT05GiHHrdps Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: ba21c1ff37bd41c0a490ec609d5d4f22 Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesActionsTest-472022873 Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:54:35.274067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ba21c1ff37bd41c0a490ec609d5d4f22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba21c1ff37bd41c0a490ec609d5d4f22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ba21c1ff37bd41c0a490ec609d5d4f22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba21c1ff37bd41c0a490ec609d5d4f22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesActionsTest-472022873 Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: ba21c1ff37bd41c0a490ec609d5d4f22 Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesActionsTest-472022873 Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesActionsTest-472022873-project Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: e8174b2b7d024b24b6d6c3578b273691 Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesActionsTest-472022873-project Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 99f2e970-0ac5-4704-a85e-618f53481c54 could not be found. Aug 12 06:54:35.276829 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '99f2e970-0ac5-4704-a85e-618f53481c54'} Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99f2e970-0ac5-4704-a85e-618f53481c54 could not be found. Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:54:35.278041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99f2e970-0ac5-4704-a85e-618f53481c54 could not be found. Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99f2e970-0ac5-4704-a85e-618f53481c54 could not be found. Aug 12 06:54:35.279469 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:54:35.280641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Returning 404 to user: Instance 99f2e970-0ac5-4704-a85e-618f53481c54 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:54:35.280641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5b10faec-1617-407a-9652-ae21b45a121a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54" status: 404 len: 111 microversion: 2.1 time: 0.036539 Aug 12 06:54:35.280641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 417/811] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:35 2022] GET /compute/v2.1/servers/99f2e970-0ac5-4704-a85e-618f53481c54 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:54:35.333329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-577501246", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452", "networks": [{"uuid": "38b3e8b2-62af-42af-9068-4d777853423a"}]}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:35.391423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] validate_networks() for [('38b3e8b2-62af-42af-9068-4d777853423a', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:54:35.744125 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:54:35.744652 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:54:35.745197 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:54:35.745605 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:54:35.746071 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:54:35.756626 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:35.757116 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:35.757551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:35.758313 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:35.758764 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:35.759221 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:35.778153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Getting quotas for project ba21c1ff37bd41c0a490ec609d5d4f22. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:54:35.782455 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Getting quotas for user e8174b2b7d024b24b6d6c3578b273691 and project ba21c1ff37bd41c0a490ec609d5d4f22. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:54:35.794431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:54:35.797354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:54:35.843083 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f80c8532-4ca4-423c-851d-a4f1be6136ff tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514032 Aug 12 06:54:35.849532 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 395/812] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:54:35.855749 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0811fa8a-6d26-4ab7-bc69-0c0f473f3697 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:35.856428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0811fa8a-6d26-4ab7-bc69-0c0f473f3697 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:35.922702 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:35.923334 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:35.928558 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0811fa8a-6d26-4ab7-bc69-0c0f473f3697 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:35.930594 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:35.931118 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:35.931874 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:35.933347 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:35.933835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:35.934240 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:35.938910 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0811fa8a-6d26-4ab7-bc69-0c0f473f3697 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1213 microversion: 2.1 time: 0.087477 Aug 12 06:54:35.952785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 418/813] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:35 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:36.080022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:36.089457 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:36.091273 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:36.092939 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ad40f871-421d-43bf-b74f-ba32e0ffc1a2 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.174469 Aug 12 06:54:36.094037 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 396/814] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:35 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:54:36.551361 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-b9c9f8af-f1fa-483a-a577-8bda5d7b2b18 req-22bf6bf3-d94d-46e9-9710-58d53e8a1da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f087d0a-dd24-4db2-9492-7d2ff7a5d63d", "tag": "96a99562-8ad9-44c6-b596-af4b26f087ae"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:36.575346 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b9c9f8af-f1fa-483a-a577-8bda5d7b2b18 req-22bf6bf3-d94d-46e9-9710-58d53e8a1da5 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:36.578020 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b9c9f8af-f1fa-483a-a577-8bda5d7b2b18 req-22bf6bf3-d94d-46e9-9710-58d53e8a1da5 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:36.578704 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b9c9f8af-f1fa-483a-a577-8bda5d7b2b18 req-22bf6bf3-d94d-46e9-9710-58d53e8a1da5 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:36.594267 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-b9c9f8af-f1fa-483a-a577-8bda5d7b2b18 req-22bf6bf3-d94d-46e9-9710-58d53e8a1da5 service nova] Creating event network-changed:96a99562-8ad9-44c6-b596-af4b26f087ae for instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d on hv-cinder-84457 Aug 12 06:54:36.611114 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-b9c9f8af-f1fa-483a-a577-8bda5d7b2b18 req-22bf6bf3-d94d-46e9-9710-58d53e8a1da5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062567 Aug 12 06:54:36.613270 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 419/815] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:36.960721 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4251b14e-acae-4ecd-bf87-015c4d8bbc77 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:36.961330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4251b14e-acae-4ecd-bf87-015c4d8bbc77 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:36.972676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4251b14e-acae-4ecd-bf87-015c4d8bbc77 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:36.973230 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4251b14e-acae-4ecd-bf87-015c4d8bbc77 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:36.973780 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4251b14e-acae-4ecd-bf87-015c4d8bbc77 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:36.974771 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4251b14e-acae-4ecd-bf87-015c4d8bbc77 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:36.975436 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4251b14e-acae-4ecd-bf87-015c4d8bbc77 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:36.975857 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4251b14e-acae-4ecd-bf87-015c4d8bbc77 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:37.067115 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4251b14e-acae-4ecd-bf87-015c4d8bbc77 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:37.077612 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4251b14e-acae-4ecd-bf87-015c4d8bbc77 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1265 microversion: 2.1 time: 0.120832 Aug 12 06:54:37.078820 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 397/816] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:36 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1265 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:37.120463 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:37.121768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:37.128535 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:37.129340 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:37.129963 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:37.130849 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:37.131495 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:37.132122 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:37.339249 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:37.350055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:37.354145 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:37.355981 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fc42218b-8fa9-4f0e-a980-b22d0bb1fcab tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1733 microversion: 2.20 time: 0.240141 Aug 12 06:54:37.357233 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 420/817] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:37 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1733 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:54:37.963699 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-693ffb2e-7574-47bf-b627-d46575145f5e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1844616839"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:37.966459 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-693ffb2e-7574-47bf-b627-d46575145f5e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:37.977282 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693ffb2e-7574-47bf-b627-d46575145f5e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:37.977828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693ffb2e-7574-47bf-b627-d46575145f5e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:37.978263 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693ffb2e-7574-47bf-b627-d46575145f5e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:37.978985 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693ffb2e-7574-47bf-b627-d46575145f5e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:37.979443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693ffb2e-7574-47bf-b627-d46575145f5e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:37.979863 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-693ffb2e-7574-47bf-b627-d46575145f5e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:38.099613 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d00a7992-53ac-41b2-9281-7fcc0935af9a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:38.100409 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d00a7992-53ac-41b2-9281-7fcc0935af9a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:38.108221 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a7992-53ac-41b2-9281-7fcc0935af9a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:38.109094 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a7992-53ac-41b2-9281-7fcc0935af9a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:38.110019 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a7992-53ac-41b2-9281-7fcc0935af9a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:38.112746 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a7992-53ac-41b2-9281-7fcc0935af9a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:38.113585 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a7992-53ac-41b2-9281-7fcc0935af9a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:38.114231 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a7992-53ac-41b2-9281-7fcc0935af9a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:38.214687 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d00a7992-53ac-41b2-9281-7fcc0935af9a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:38.225197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d00a7992-53ac-41b2-9281-7fcc0935af9a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1271 microversion: 2.1 time: 0.129347 Aug 12 06:54:38.238746 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 421/818] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:38 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:38.244086 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.network.security_group_api [None req-693ffb2e-7574-47bf-b627-d46575145f5e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Adding security group 185e0e81-f306-492c-a774-d8fa5730388c to port 96a99562-8ad9-44c6-b596-af4b26f087ae Aug 12 06:54:38.379500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:38.380063 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:38.387006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:38.387532 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:38.387957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:38.388720 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:38.389186 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:38.389601 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:38.706336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:38.716490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:38.718015 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:38.719204 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-191d1f8a-8096-424b-ae40-ed5775079ab5 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1720 microversion: 2.20 time: 0.343607 Aug 12 06:54:38.719747 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 422/819] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:54:38 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1720 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:54:38.800335 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-693ffb2e-7574-47bf-b627-d46575145f5e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "POST /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/action" status: 202 len: 0 microversion: 2.1 time: 0.843296 Aug 12 06:54:38.801522 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 398/820] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:54:37 2022] POST /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/action => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:54:38.807058 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-25376cf7-c0c0-4255-b02d-ffe9762da61a req-d6dff4b5-c92f-4134-9818-4e799b039b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f087d0a-dd24-4db2-9492-7d2ff7a5d63d", "tag": "96a99562-8ad9-44c6-b596-af4b26f087ae"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:38.809996 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-99ccbad9-d25e-43b5-8e29-6acb50aa99e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:38.810733 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-99ccbad9-d25e-43b5-8e29-6acb50aa99e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:38.819647 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-25376cf7-c0c0-4255-b02d-ffe9762da61a req-d6dff4b5-c92f-4134-9818-4e799b039b48 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:38.820418 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-25376cf7-c0c0-4255-b02d-ffe9762da61a req-d6dff4b5-c92f-4134-9818-4e799b039b48 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:38.821221 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-25376cf7-c0c0-4255-b02d-ffe9762da61a req-d6dff4b5-c92f-4134-9818-4e799b039b48 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:38.832254 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99ccbad9-d25e-43b5-8e29-6acb50aa99e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:38.832899 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99ccbad9-d25e-43b5-8e29-6acb50aa99e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:38.834846 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-25376cf7-c0c0-4255-b02d-ffe9762da61a req-d6dff4b5-c92f-4134-9818-4e799b039b48 service nova] Creating event network-changed:96a99562-8ad9-44c6-b596-af4b26f087ae for instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d on hv-cinder-84457 Aug 12 06:54:38.835366 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99ccbad9-d25e-43b5-8e29-6acb50aa99e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:38.836384 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99ccbad9-d25e-43b5-8e29-6acb50aa99e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:38.837064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99ccbad9-d25e-43b5-8e29-6acb50aa99e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:38.839166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99ccbad9-d25e-43b5-8e29-6acb50aa99e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:38.840722 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-25376cf7-c0c0-4255-b02d-ffe9762da61a req-d6dff4b5-c92f-4134-9818-4e799b039b48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037235 Aug 12 06:54:38.842067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 423/821] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:39.157314 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-99ccbad9-d25e-43b5-8e29-6acb50aa99e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:39.179042 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-a92500c1-e737-4006-87b8-1b131db6dca8 req-02730c0f-1cc0-4dde-957f-619f9ca0c3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22279b7a-0f97-417a-bb84-44bb01f787d7", "tag": "96b57c4d-9b7b-4b18-8ef8-92f6b7fe588e"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:39.205284 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-99ccbad9-d25e-43b5-8e29-6acb50aa99e6 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1761 microversion: 2.1 time: 0.397210 Aug 12 06:54:39.208320 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 399/822] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:38 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1761 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:39.212555 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a92500c1-e737-4006-87b8-1b131db6dca8 req-02730c0f-1cc0-4dde-957f-619f9ca0c3b3 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:39.213028 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a92500c1-e737-4006-87b8-1b131db6dca8 req-02730c0f-1cc0-4dde-957f-619f9ca0c3b3 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:39.213448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a92500c1-e737-4006-87b8-1b131db6dca8 req-02730c0f-1cc0-4dde-957f-619f9ca0c3b3 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:39.249323 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-92f6d62f-a6e4-4b9c-b16b-c4dd943d7654 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:39.250255 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-92f6d62f-a6e4-4b9c-b16b-c4dd943d7654 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:39.254769 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-a92500c1-e737-4006-87b8-1b131db6dca8 req-02730c0f-1cc0-4dde-957f-619f9ca0c3b3 service nova] Creating event network-changed:96b57c4d-9b7b-4b18-8ef8-92f6b7fe588e for instance 22279b7a-0f97-417a-bb84-44bb01f787d7 on hv-cinder-84457 Aug 12 06:54:39.265412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92f6d62f-a6e4-4b9c-b16b-c4dd943d7654 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:39.266157 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92f6d62f-a6e4-4b9c-b16b-c4dd943d7654 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:39.266739 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92f6d62f-a6e4-4b9c-b16b-c4dd943d7654 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:39.267209 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-a92500c1-e737-4006-87b8-1b131db6dca8 req-02730c0f-1cc0-4dde-957f-619f9ca0c3b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101032 Aug 12 06:54:39.268510 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 424/823] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:39.270431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92f6d62f-a6e4-4b9c-b16b-c4dd943d7654 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:39.271632 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92f6d62f-a6e4-4b9c-b16b-c4dd943d7654 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:39.272114 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92f6d62f-a6e4-4b9c-b16b-c4dd943d7654 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:39.431871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-92f6d62f-a6e4-4b9c-b16b-c4dd943d7654 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:39.439615 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-92f6d62f-a6e4-4b9c-b16b-c4dd943d7654 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1313 microversion: 2.1 time: 0.197544 Aug 12 06:54:39.440829 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 400/824] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:39 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:40.465592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6ccf2034-80ac-47dd-a1ba-121301ad6583 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:40.466571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6ccf2034-80ac-47dd-a1ba-121301ad6583 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:40.477030 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ccf2034-80ac-47dd-a1ba-121301ad6583 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:40.477944 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ccf2034-80ac-47dd-a1ba-121301ad6583 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:40.478504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ccf2034-80ac-47dd-a1ba-121301ad6583 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:40.479706 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ccf2034-80ac-47dd-a1ba-121301ad6583 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:40.480454 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ccf2034-80ac-47dd-a1ba-121301ad6583 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:40.481049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ccf2034-80ac-47dd-a1ba-121301ad6583 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:40.615230 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ccf2034-80ac-47dd-a1ba-121301ad6583 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:40.622921 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6ccf2034-80ac-47dd-a1ba-121301ad6583 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1313 microversion: 2.1 time: 0.164735 Aug 12 06:54:40.623603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 425/825] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:40 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:40.669731 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fa99640e-f40c-4b4b-b45a-609a6a2c793d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:40.672043 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fa99640e-f40c-4b4b-b45a-609a6a2c793d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:40.679039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa99640e-f40c-4b4b-b45a-609a6a2c793d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:40.679567 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa99640e-f40c-4b4b-b45a-609a6a2c793d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:40.680000 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa99640e-f40c-4b4b-b45a-609a6a2c793d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:40.680707 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa99640e-f40c-4b4b-b45a-609a6a2c793d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:40.681161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa99640e-f40c-4b4b-b45a-609a6a2c793d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:40.681595 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa99640e-f40c-4b4b-b45a-609a6a2c793d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:40.713864 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fa99640e-f40c-4b4b-b45a-609a6a2c793d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050049 Aug 12 06:54:40.714423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 401/826] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:54:40 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:40.726241 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8c5fd95e-ef63-4df7-bdc1-23b234d050e9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:40.726873 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8c5fd95e-ef63-4df7-bdc1-23b234d050e9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:40.733085 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c5fd95e-ef63-4df7-bdc1-23b234d050e9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:40.733535 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c5fd95e-ef63-4df7-bdc1-23b234d050e9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:40.733962 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c5fd95e-ef63-4df7-bdc1-23b234d050e9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:40.734645 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c5fd95e-ef63-4df7-bdc1-23b234d050e9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:40.735118 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c5fd95e-ef63-4df7-bdc1-23b234d050e9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:40.735531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c5fd95e-ef63-4df7-bdc1-23b234d050e9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:40.761144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:40.768772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8c5fd95e-ef63-4df7-bdc1-23b234d050e9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments/8052471e-7bc7-48c2-b352-963f2580fc0a" status: 200 len: 194 microversion: 2.1 time: 0.046976 Aug 12 06:54:40.769373 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 426/827] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Aug 12 06:54:40 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments/8052471e-7bc7-48c2-b352-963f2580fc0a => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:54:41.644525 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e94a6528-41e4-40e2-9c69-5fbb22e10c56 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:41.645137 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e94a6528-41e4-40e2-9c69-5fbb22e10c56 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:41.651848 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e94a6528-41e4-40e2-9c69-5fbb22e10c56 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:41.652331 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e94a6528-41e4-40e2-9c69-5fbb22e10c56 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:41.652748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e94a6528-41e4-40e2-9c69-5fbb22e10c56 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:41.653449 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e94a6528-41e4-40e2-9c69-5fbb22e10c56 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:41.653989 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e94a6528-41e4-40e2-9c69-5fbb22e10c56 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:41.654403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e94a6528-41e4-40e2-9c69-5fbb22e10c56 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:41.792574 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e94a6528-41e4-40e2-9c69-5fbb22e10c56 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:41.800798 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e94a6528-41e4-40e2-9c69-5fbb22e10c56 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1313 microversion: 2.1 time: 0.160606 Aug 12 06:54:41.801372 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 402/828] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:41 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:42.134701 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-114e5292-7f81-4390-b80e-6b5ace8ec0d9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb4a1565-87d0-4e97-8da0-fb822511e1be"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:42.138692 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-114e5292-7f81-4390-b80e-6b5ace8ec0d9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:42.146248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-114e5292-7f81-4390-b80e-6b5ace8ec0d9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:42.146727 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-114e5292-7f81-4390-b80e-6b5ace8ec0d9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:42.147191 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-114e5292-7f81-4390-b80e-6b5ace8ec0d9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:42.147878 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-114e5292-7f81-4390-b80e-6b5ace8ec0d9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:42.148318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-114e5292-7f81-4390-b80e-6b5ace8ec0d9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:42.148739 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-114e5292-7f81-4390-b80e-6b5ace8ec0d9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:42.432130 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-114e5292-7f81-4390-b80e-6b5ace8ec0d9 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "POST /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303829 Aug 12 06:54:42.433032 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 427/829] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 06:54:42 2022] POST /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:42.822145 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e9c9bba2-7deb-44ef-a324-5f0121c2975d tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:42.822834 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e9c9bba2-7deb-44ef-a324-5f0121c2975d tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:42.829840 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9c9bba2-7deb-44ef-a324-5f0121c2975d tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:42.830326 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9c9bba2-7deb-44ef-a324-5f0121c2975d tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:42.830764 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9c9bba2-7deb-44ef-a324-5f0121c2975d tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:42.831499 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9c9bba2-7deb-44ef-a324-5f0121c2975d tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:42.831957 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9c9bba2-7deb-44ef-a324-5f0121c2975d tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:42.832378 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9c9bba2-7deb-44ef-a324-5f0121c2975d tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:42.963726 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e9c9bba2-7deb-44ef-a324-5f0121c2975d tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:42.971540 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e9c9bba2-7deb-44ef-a324-5f0121c2975d tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1313 microversion: 2.1 time: 0.153579 Aug 12 06:54:42.972205 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 403/830] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:42 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:43.993148 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9b7dab45-0183-43b6-ab0f-9fa4fd68d1c3 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:43.993827 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b7dab45-0183-43b6-ab0f-9fa4fd68d1c3 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:44.001299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b7dab45-0183-43b6-ab0f-9fa4fd68d1c3 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:44.001806 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b7dab45-0183-43b6-ab0f-9fa4fd68d1c3 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:44.002240 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b7dab45-0183-43b6-ab0f-9fa4fd68d1c3 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:44.002934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b7dab45-0183-43b6-ab0f-9fa4fd68d1c3 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:44.003428 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b7dab45-0183-43b6-ab0f-9fa4fd68d1c3 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:44.003848 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b7dab45-0183-43b6-ab0f-9fa4fd68d1c3 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:44.140527 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b7dab45-0183-43b6-ab0f-9fa4fd68d1c3 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:44.148460 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9b7dab45-0183-43b6-ab0f-9fa4fd68d1c3 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1313 microversion: 2.1 time: 0.159627 Aug 12 06:54:44.149052 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 428/831] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:43 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:44.969460 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-edac6e25-1648-4bea-8628-3d0882d32bf4 req-097d885a-5da3-4dd8-aeee-4499a3e721f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22279b7a-0f97-417a-bb84-44bb01f787d7", "name": "network-vif-plugged", "status": "completed", "tag": "96b57c4d-9b7b-4b18-8ef8-92f6b7fe588e"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:44.979879 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-edac6e25-1648-4bea-8628-3d0882d32bf4 req-097d885a-5da3-4dd8-aeee-4499a3e721f3 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:44.980507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-edac6e25-1648-4bea-8628-3d0882d32bf4 req-097d885a-5da3-4dd8-aeee-4499a3e721f3 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:44.980937 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-edac6e25-1648-4bea-8628-3d0882d32bf4 req-097d885a-5da3-4dd8-aeee-4499a3e721f3 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:44.992325 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-edac6e25-1648-4bea-8628-3d0882d32bf4 req-097d885a-5da3-4dd8-aeee-4499a3e721f3 service nova] Creating event network-vif-plugged:96b57c4d-9b7b-4b18-8ef8-92f6b7fe588e for instance 22279b7a-0f97-417a-bb84-44bb01f787d7 on hv-cinder-84457 Aug 12 06:54:44.997237 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-edac6e25-1648-4bea-8628-3d0882d32bf4 req-097d885a-5da3-4dd8-aeee-4499a3e721f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031568 Aug 12 06:54:44.998038 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 404/832] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:45.176532 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-40743172-0f94-4025-95ff-af725e8a961e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:45.177156 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-40743172-0f94-4025-95ff-af725e8a961e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:45.184098 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40743172-0f94-4025-95ff-af725e8a961e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:45.184568 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40743172-0f94-4025-95ff-af725e8a961e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:45.184993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40743172-0f94-4025-95ff-af725e8a961e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:45.185674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40743172-0f94-4025-95ff-af725e8a961e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:45.186114 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40743172-0f94-4025-95ff-af725e8a961e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:45.186523 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40743172-0f94-4025-95ff-af725e8a961e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:45.316671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-40743172-0f94-4025-95ff-af725e8a961e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:45.324173 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-40743172-0f94-4025-95ff-af725e8a961e tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1313 microversion: 2.1 time: 0.151563 Aug 12 06:54:45.324736 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 429/833] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:45 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:46.346202 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8cd598a5-eb45-427d-99c5-8d70791747be tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:46.347008 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8cd598a5-eb45-427d-99c5-8d70791747be tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:46.349032 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:46.349687 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:46.356109 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cd598a5-eb45-427d-99c5-8d70791747be tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:46.356594 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cd598a5-eb45-427d-99c5-8d70791747be tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:46.357025 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cd598a5-eb45-427d-99c5-8d70791747be tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:46.357791 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cd598a5-eb45-427d-99c5-8d70791747be tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:46.358247 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cd598a5-eb45-427d-99c5-8d70791747be tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:46.358661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8cd598a5-eb45-427d-99c5-8d70791747be tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:46.363192 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:46.493063 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8cd598a5-eb45-427d-99c5-8d70791747be tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:46.500878 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8cd598a5-eb45-427d-99c5-8d70791747be tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1313 microversion: 2.1 time: 0.159086 Aug 12 06:54:46.501425 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 405/834] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:46 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:47.526690 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e8201d41-c8a3-4931-bd9d-003633a1e420 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:47.527734 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e8201d41-c8a3-4931-bd9d-003633a1e420 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:47.531048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:47.537298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8201d41-c8a3-4931-bd9d-003633a1e420 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:47.537788 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8201d41-c8a3-4931-bd9d-003633a1e420 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:47.538250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8201d41-c8a3-4931-bd9d-003633a1e420 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:47.538942 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8201d41-c8a3-4931-bd9d-003633a1e420 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:47.539417 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8201d41-c8a3-4931-bd9d-003633a1e420 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:47.539834 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8201d41-c8a3-4931-bd9d-003633a1e420 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:47.672830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e8201d41-c8a3-4931-bd9d-003633a1e420 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:47.680925 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e8201d41-c8a3-4931-bd9d-003633a1e420 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1496 microversion: 2.1 time: 0.161145 Aug 12 06:54:47.681491 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 430/835] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:47 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:48.356461 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-15db2627-18f2-4eb3-839c-8ecf8199be30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:48.357020 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-15db2627-18f2-4eb3-839c-8ecf8199be30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:48.363453 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15db2627-18f2-4eb3-839c-8ecf8199be30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:48.363933 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15db2627-18f2-4eb3-839c-8ecf8199be30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:48.364334 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15db2627-18f2-4eb3-839c-8ecf8199be30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:48.365066 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15db2627-18f2-4eb3-839c-8ecf8199be30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:48.365515 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15db2627-18f2-4eb3-839c-8ecf8199be30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:48.365932 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15db2627-18f2-4eb3-839c-8ecf8199be30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:48.399692 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9b36312e-c337-4cbd-8845-79c836433f4a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:48.400174 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b36312e-c337-4cbd-8845-79c836433f4a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:48.402095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:48.408446 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b36312e-c337-4cbd-8845-79c836433f4a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:48.409162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b36312e-c337-4cbd-8845-79c836433f4a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:48.409659 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b36312e-c337-4cbd-8845-79c836433f4a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:48.410358 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b36312e-c337-4cbd-8845-79c836433f4a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:48.410801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b36312e-c337-4cbd-8845-79c836433f4a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:48.411237 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b36312e-c337-4cbd-8845-79c836433f4a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:48.436351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b36312e-c337-4cbd-8845-79c836433f4a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:54:48.448656 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-15db2627-18f2-4eb3-839c-8ecf8199be30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lazy-loading 'services' on Instance uuid da9145d8-3483-4e57-8350-b4b26927dff1 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:54:48.525864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9b36312e-c337-4cbd-8845-79c836433f4a tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "DELETE /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 204 len: 0 microversion: 2.1 time: 0.129384 Aug 12 06:54:48.526590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 431/836] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:54:48 2022] DELETE /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:54:48.535570 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-15db2627-18f2-4eb3-839c-8ecf8199be30 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments/af10f280-0bab-413f-8a15-461d4ba1818d" status: 202 len: 0 microversion: 2.1 time: 0.183023 Aug 12 06:54:48.539551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 406/837] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:54:48 2022] DELETE /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments/af10f280-0bab-413f-8a15-461d4ba1818d => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:54:48.539695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-576b9494-375d-4554-b721-fbda65b85561 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:48.539695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-576b9494-375d-4554-b721-fbda65b85561 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:48.544286 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-576b9494-375d-4554-b721-fbda65b85561 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:48.544790 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-576b9494-375d-4554-b721-fbda65b85561 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:48.544993 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-87aef59f-3c8e-4cd7-aebf-bcc1d5868d39 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:48.545181 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-576b9494-375d-4554-b721-fbda65b85561 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:48.545891 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-576b9494-375d-4554-b721-fbda65b85561 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:48.546325 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-576b9494-375d-4554-b721-fbda65b85561 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:48.546719 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-576b9494-375d-4554-b721-fbda65b85561 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:48.547512 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-87aef59f-3c8e-4cd7-aebf-bcc1d5868d39 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:48.554941 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87aef59f-3c8e-4cd7-aebf-bcc1d5868d39 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:48.555461 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87aef59f-3c8e-4cd7-aebf-bcc1d5868d39 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:48.555890 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87aef59f-3c8e-4cd7-aebf-bcc1d5868d39 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:48.556604 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87aef59f-3c8e-4cd7-aebf-bcc1d5868d39 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:48.557057 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87aef59f-3c8e-4cd7-aebf-bcc1d5868d39 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:48.557476 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87aef59f-3c8e-4cd7-aebf-bcc1d5868d39 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:48.588005 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-87aef59f-3c8e-4cd7-aebf-bcc1d5868d39 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047138 Aug 12 06:54:48.589018 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 407/838] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:54:48 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:48.683493 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-576b9494-375d-4554-b721-fbda65b85561 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:48.692648 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-576b9494-375d-4554-b721-fbda65b85561 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1502 microversion: 2.1 time: 0.159651 Aug 12 06:54:48.693245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 432/839] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:48 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:49.605190 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a13615a5-a885-4361-8b7e-03907ea9b7e8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:49.608388 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a13615a5-a885-4361-8b7e-03907ea9b7e8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:49.615592 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a13615a5-a885-4361-8b7e-03907ea9b7e8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:49.616099 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a13615a5-a885-4361-8b7e-03907ea9b7e8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:49.616546 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a13615a5-a885-4361-8b7e-03907ea9b7e8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:49.617266 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a13615a5-a885-4361-8b7e-03907ea9b7e8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:49.617735 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a13615a5-a885-4361-8b7e-03907ea9b7e8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:49.618171 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a13615a5-a885-4361-8b7e-03907ea9b7e8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:49.648843 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a13615a5-a885-4361-8b7e-03907ea9b7e8 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050317 Aug 12 06:54:49.649388 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 408/840] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:54:49 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:49.717735 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14652ba7-bf02-43b7-9de1-25af1e567578 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:49.718319 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-14652ba7-bf02-43b7-9de1-25af1e567578 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:49.725181 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14652ba7-bf02-43b7-9de1-25af1e567578 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:49.725665 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14652ba7-bf02-43b7-9de1-25af1e567578 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:49.726093 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14652ba7-bf02-43b7-9de1-25af1e567578 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:49.726784 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14652ba7-bf02-43b7-9de1-25af1e567578 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:49.727275 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14652ba7-bf02-43b7-9de1-25af1e567578 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:49.727702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14652ba7-bf02-43b7-9de1-25af1e567578 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:49.870458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-14652ba7-bf02-43b7-9de1-25af1e567578 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:49.878423 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-14652ba7-bf02-43b7-9de1-25af1e567578 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1502 microversion: 2.1 time: 0.166781 Aug 12 06:54:49.878994 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 433/841] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:49 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:50.661987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-77144d96-0281-4ab1-a9d0-5baab29838a4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:50.665040 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-77144d96-0281-4ab1-a9d0-5baab29838a4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:50.671806 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77144d96-0281-4ab1-a9d0-5baab29838a4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:50.672494 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77144d96-0281-4ab1-a9d0-5baab29838a4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:50.673093 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77144d96-0281-4ab1-a9d0-5baab29838a4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:50.673797 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77144d96-0281-4ab1-a9d0-5baab29838a4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:50.674243 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77144d96-0281-4ab1-a9d0-5baab29838a4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:50.674653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77144d96-0281-4ab1-a9d0-5baab29838a4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:50.700236 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-fc015a36-496f-4dbb-bca9-65de22924726 req-a702d089-6b71-429c-b921-e73000ae3a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22279b7a-0f97-417a-bb84-44bb01f787d7", "name": "network-vif-deleted", "tag": "96b57c4d-9b7b-4b18-8ef8-92f6b7fe588e"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:50.705062 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-77144d96-0281-4ab1-a9d0-5baab29838a4 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047585 Aug 12 06:54:50.705669 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 409/842] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:54:50 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:50.711468 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fc015a36-496f-4dbb-bca9-65de22924726 req-a702d089-6b71-429c-b921-e73000ae3a0d service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:50.711959 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fc015a36-496f-4dbb-bca9-65de22924726 req-a702d089-6b71-429c-b921-e73000ae3a0d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:50.712374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fc015a36-496f-4dbb-bca9-65de22924726 req-a702d089-6b71-429c-b921-e73000ae3a0d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:50.724280 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-fc015a36-496f-4dbb-bca9-65de22924726 req-a702d089-6b71-429c-b921-e73000ae3a0d service nova] Creating event network-vif-deleted:96b57c4d-9b7b-4b18-8ef8-92f6b7fe588e for instance 22279b7a-0f97-417a-bb84-44bb01f787d7 on hv-cinder-84457 Aug 12 06:54:50.728937 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-fc015a36-496f-4dbb-bca9-65de22924726 req-a702d089-6b71-429c-b921-e73000ae3a0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032273 Aug 12 06:54:50.729800 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 434/843] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:50.903068 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:50.903814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:50.913570 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:50.914264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:50.915263 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:50.916359 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:50.917057 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:50.917674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:50.951127 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:50.951622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:50.952050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:50.952483 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lazy-loading 'fault' on Instance uuid 22279b7a-0f97-417a-bb84-44bb01f787d7 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:54:50.993756 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8174b2b7d024b24b6d6c3578b273691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba21c1ff37bd41c0a490ec609d5d4f22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:51.001302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2adae3e3-8ea7-4da9-a70b-69baec03f2aa tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 200 len: 1303 microversion: 2.1 time: 0.104374 Aug 12 06:54:51.001858 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 410/844] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:50 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:51.204964 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-13c79720-8baa-4254-bd31-75de4db9a1be tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:54:51.207340 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-13c79720-8baa-4254-bd31-75de4db9a1be tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:51.213703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13c79720-8baa-4254-bd31-75de4db9a1be tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:51.214182 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13c79720-8baa-4254-bd31-75de4db9a1be tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:51.214651 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13c79720-8baa-4254-bd31-75de4db9a1be tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:51.215383 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13c79720-8baa-4254-bd31-75de4db9a1be tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:51.215834 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13c79720-8baa-4254-bd31-75de4db9a1be tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:51.216281 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13c79720-8baa-4254-bd31-75de4db9a1be tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:51.291244 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-13c79720-8baa-4254-bd31-75de4db9a1be tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "POST /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/action" status: 202 len: 0 microversion: 2.1 time: 0.090445 Aug 12 06:54:51.291874 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 435/845] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:54:51 2022] POST /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:54:51.300199 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-af4529dd-3a9c-4654-9356-c81c3837d1ca tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:51.300810 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-af4529dd-3a9c-4654-9356-c81c3837d1ca tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:51.306953 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af4529dd-3a9c-4654-9356-c81c3837d1ca tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:51.307464 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af4529dd-3a9c-4654-9356-c81c3837d1ca tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:51.307894 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af4529dd-3a9c-4654-9356-c81c3837d1ca tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:51.308580 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af4529dd-3a9c-4654-9356-c81c3837d1ca tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:51.309037 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af4529dd-3a9c-4654-9356-c81c3837d1ca tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:51.309458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af4529dd-3a9c-4654-9356-c81c3837d1ca tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:51.462892 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-af4529dd-3a9c-4654-9356-c81c3837d1ca tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:51.477954 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-af4529dd-3a9c-4654-9356-c81c3837d1ca tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1753 microversion: 2.1 time: 0.181671 Aug 12 06:54:51.478539 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 411/846] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:51 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:51.719799 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b482f18f-be2f-4401-8d80-9e4618e5feb9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:51.721974 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b482f18f-be2f-4401-8d80-9e4618e5feb9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:51.728766 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b482f18f-be2f-4401-8d80-9e4618e5feb9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:51.729360 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b482f18f-be2f-4401-8d80-9e4618e5feb9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:51.729667 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b482f18f-be2f-4401-8d80-9e4618e5feb9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:51.730352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b482f18f-be2f-4401-8d80-9e4618e5feb9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:51.730811 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b482f18f-be2f-4401-8d80-9e4618e5feb9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:51.731261 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b482f18f-be2f-4401-8d80-9e4618e5feb9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:51.760781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b482f18f-be2f-4401-8d80-9e4618e5feb9 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045546 Aug 12 06:54:51.761330 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 436/847] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:54:51 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:52.026847 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:52.028108 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] [instance: 22279b7a-0f97-417a-bb84-44bb01f787d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:52.035414 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:52.035902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:52.036345 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:52.037081 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:52.037480 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:52.037903 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:52.051916 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] HTTP exception thrown: Instance 22279b7a-0f97-417a-bb84-44bb01f787d7 could not be found. Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Request method failure captured: Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 HTTP/1.1 Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fkM8vtXS8CFvGTfnQuhks4I_m9Gj1dlQl5o8q_mwFoAtukm93aFqGVSffgiVKEhb7YnHOkMeyCFVkiE1I4TjxBU0X22oJPqynemwqby3sh4XntPSGD0SPzDpCW7sO0igFB5NDr4eOrd-9jbHJJRPR_e-Uibo4Z32WljT05GiHHrdps Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: ba21c1ff37bd41c0a490ec609d5d4f22 Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesActionsTest-472022873 Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:54:52.053737 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ba21c1ff37bd41c0a490ec609d5d4f22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba21c1ff37bd41c0a490ec609d5d4f22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ba21c1ff37bd41c0a490ec609d5d4f22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ba21c1ff37bd41c0a490ec609d5d4f22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesActionsTest-472022873 Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: ba21c1ff37bd41c0a490ec609d5d4f22 Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesActionsTest-472022873 Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesActionsTest-472022873-project Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: e8174b2b7d024b24b6d6c3578b273691 Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesActionsTest-472022873-project Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 22279b7a-0f97-417a-bb84-44bb01f787d7 could not be found. Aug 12 06:54:52.055458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '22279b7a-0f97-417a-bb84-44bb01f787d7'} Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22279b7a-0f97-417a-bb84-44bb01f787d7 could not be found. Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:54:52.056562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22279b7a-0f97-417a-bb84-44bb01f787d7 could not be found. Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22279b7a-0f97-417a-bb84-44bb01f787d7 could not be found. Aug 12 06:54:52.058871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:54:52.061169 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] Returning 404 to user: Instance 22279b7a-0f97-417a-bb84-44bb01f787d7 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:54:52.061169 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-23a74812-6f1b-4663-b778-4e6340c3f3e6 tempest-VolumesActionsTest-472022873 tempest-VolumesActionsTest-472022873-project] 10.222.0.20 "GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7" status: 404 len: 111 microversion: 2.1 time: 0.034985 Aug 12 06:54:52.061169 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 412/848] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:52 2022] GET /compute/v2.1/servers/22279b7a-0f97-417a-bb84-44bb01f787d7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:54:52.506878 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-98ea340a-4c5a-423f-b3c0-689adb9e8c69 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:52.507571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-98ea340a-4c5a-423f-b3c0-689adb9e8c69 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:52.518064 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98ea340a-4c5a-423f-b3c0-689adb9e8c69 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:52.518555 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98ea340a-4c5a-423f-b3c0-689adb9e8c69 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:52.519002 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98ea340a-4c5a-423f-b3c0-689adb9e8c69 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:52.519773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98ea340a-4c5a-423f-b3c0-689adb9e8c69 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:52.520224 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98ea340a-4c5a-423f-b3c0-689adb9e8c69 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:52.520799 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98ea340a-4c5a-423f-b3c0-689adb9e8c69 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:52.668427 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-98ea340a-4c5a-423f-b3c0-689adb9e8c69 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:52.677351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-98ea340a-4c5a-423f-b3c0-689adb9e8c69 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1753 microversion: 2.1 time: 0.174342 Aug 12 06:54:52.678170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 437/849] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:52 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:52.773479 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f63a15e6-cda6-404e-98cb-efb427aa1446 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:52.775834 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f63a15e6-cda6-404e-98cb-efb427aa1446 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:52.782118 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f63a15e6-cda6-404e-98cb-efb427aa1446 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:52.782606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f63a15e6-cda6-404e-98cb-efb427aa1446 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:52.783060 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f63a15e6-cda6-404e-98cb-efb427aa1446 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:52.784014 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f63a15e6-cda6-404e-98cb-efb427aa1446 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:52.784472 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f63a15e6-cda6-404e-98cb-efb427aa1446 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:52.784901 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f63a15e6-cda6-404e-98cb-efb427aa1446 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:52.817432 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f63a15e6-cda6-404e-98cb-efb427aa1446 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047876 Aug 12 06:54:52.818886 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 413/850] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:54:52 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:53.190271 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5e5145d6-ba49-4cec-ab7f-7e312ecaad6d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:53.192555 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5e5145d6-ba49-4cec-ab7f-7e312ecaad6d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:53.199703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e5145d6-ba49-4cec-ab7f-7e312ecaad6d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:53.200183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e5145d6-ba49-4cec-ab7f-7e312ecaad6d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:53.200612 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e5145d6-ba49-4cec-ab7f-7e312ecaad6d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:53.201421 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e5145d6-ba49-4cec-ab7f-7e312ecaad6d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:53.201866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e5145d6-ba49-4cec-ab7f-7e312ecaad6d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:53.202280 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e5145d6-ba49-4cec-ab7f-7e312ecaad6d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:53.232957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5e5145d6-ba49-4cec-ab7f-7e312ecaad6d tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046668 Aug 12 06:54:53.233525 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 438/851] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:54:53 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:53.358430 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d8bcc9f5-d345-4a88-9a35-741359d55e0b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:53.358908 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d8bcc9f5-d345-4a88-9a35-741359d55e0b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:53.365747 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8bcc9f5-d345-4a88-9a35-741359d55e0b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:53.366225 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8bcc9f5-d345-4a88-9a35-741359d55e0b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:53.366656 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8bcc9f5-d345-4a88-9a35-741359d55e0b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:53.367375 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8bcc9f5-d345-4a88-9a35-741359d55e0b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:53.367847 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8bcc9f5-d345-4a88-9a35-741359d55e0b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:53.368266 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8bcc9f5-d345-4a88-9a35-741359d55e0b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:53.397006 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d8bcc9f5-d345-4a88-9a35-741359d55e0b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments/8052471e-7bc7-48c2-b352-963f2580fc0a" status: 200 len: 194 microversion: 2.1 time: 0.045188 Aug 12 06:54:53.397578 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 414/852] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Aug 12 06:54:53 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments/8052471e-7bc7-48c2-b352-963f2580fc0a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:53.413967 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b2c7e412-fcf8-43ba-af1d-ffe6b04ff0ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:53.414671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b2c7e412-fcf8-43ba-af1d-ffe6b04ff0ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:53.422967 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2c7e412-fcf8-43ba-af1d-ffe6b04ff0ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:53.423483 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2c7e412-fcf8-43ba-af1d-ffe6b04ff0ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:53.423923 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2c7e412-fcf8-43ba-af1d-ffe6b04ff0ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:53.424644 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2c7e412-fcf8-43ba-af1d-ffe6b04ff0ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:53.425105 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2c7e412-fcf8-43ba-af1d-ffe6b04ff0ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:53.425524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2c7e412-fcf8-43ba-af1d-ffe6b04ff0ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:53.511146 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-b2c7e412-fcf8-43ba-af1d-ffe6b04ff0ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lazy-loading 'services' on Instance uuid 6ec690cd-9235-4c52-95c6-b6f74a37e813 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:54:53.515303 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:53.586916 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b2c7e412-fcf8-43ba-af1d-ffe6b04ff0ea tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments/8052471e-7bc7-48c2-b352-963f2580fc0a" status: 202 len: 0 microversion: 2.1 time: 0.178996 Aug 12 06:54:53.587445 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 439/853] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:54:53 2022] DELETE /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments/8052471e-7bc7-48c2-b352-963f2580fc0a => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:54:53.700999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0613f632-eaea-4d10-9934-d86285219319 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:53.701864 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0613f632-eaea-4d10-9934-d86285219319 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:53.710284 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0613f632-eaea-4d10-9934-d86285219319 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:53.710968 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0613f632-eaea-4d10-9934-d86285219319 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:53.711615 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0613f632-eaea-4d10-9934-d86285219319 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:53.712545 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0613f632-eaea-4d10-9934-d86285219319 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:53.713171 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0613f632-eaea-4d10-9934-d86285219319 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:53.713764 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0613f632-eaea-4d10-9934-d86285219319 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:53.830105 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-69061421-ce85-4b42-b405-a63e02d75645 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:53.832453 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-69061421-ce85-4b42-b405-a63e02d75645 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:53.838923 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69061421-ce85-4b42-b405-a63e02d75645 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:53.839371 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69061421-ce85-4b42-b405-a63e02d75645 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:53.839793 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69061421-ce85-4b42-b405-a63e02d75645 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:53.840493 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69061421-ce85-4b42-b405-a63e02d75645 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:53.840923 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69061421-ce85-4b42-b405-a63e02d75645 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:53.841316 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69061421-ce85-4b42-b405-a63e02d75645 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:53.862989 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0613f632-eaea-4d10-9934-d86285219319 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:53.871301 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-69061421-ce85-4b42-b405-a63e02d75645 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045761 Aug 12 06:54:53.871850 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0613f632-eaea-4d10-9934-d86285219319 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1753 microversion: 2.1 time: 0.176537 Aug 12 06:54:53.871992 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 440/854] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:54:53 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:53.872417 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 415/855] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:53 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:54.884014 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3ef5c64f-0e3c-42ac-8843-48b3747eef74 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:54.886193 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3ef5c64f-0e3c-42ac-8843-48b3747eef74 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:54.894430 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef5c64f-0e3c-42ac-8843-48b3747eef74 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:54.895293 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef5c64f-0e3c-42ac-8843-48b3747eef74 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:54.896048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef5c64f-0e3c-42ac-8843-48b3747eef74 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:54.897254 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef5c64f-0e3c-42ac-8843-48b3747eef74 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:54.897928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bd3f66b7-abdf-430e-8ed6-1672621a715a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:54.898411 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef5c64f-0e3c-42ac-8843-48b3747eef74 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:54.898498 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bd3f66b7-abdf-430e-8ed6-1672621a715a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:54.898823 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ef5c64f-0e3c-42ac-8843-48b3747eef74 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:54.905569 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd3f66b7-abdf-430e-8ed6-1672621a715a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:54.906086 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd3f66b7-abdf-430e-8ed6-1672621a715a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:54.906490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd3f66b7-abdf-430e-8ed6-1672621a715a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:54.907254 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd3f66b7-abdf-430e-8ed6-1672621a715a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:54.907701 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd3f66b7-abdf-430e-8ed6-1672621a715a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:54.908121 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd3f66b7-abdf-430e-8ed6-1672621a715a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:54.933460 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3ef5c64f-0e3c-42ac-8843-48b3747eef74 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053451 Aug 12 06:54:54.934019 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 441/856] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:54:54 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:55.068201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd3f66b7-abdf-430e-8ed6-1672621a715a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:55.081249 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bd3f66b7-abdf-430e-8ed6-1672621a715a tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1753 microversion: 2.1 time: 0.187056 Aug 12 06:54:55.082102 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 416/857] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:54 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:55.945945 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8bcc307e-1122-4d45-8aa8-493e4973bd71 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:55.948485 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8bcc307e-1122-4d45-8aa8-493e4973bd71 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:55.955280 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bcc307e-1122-4d45-8aa8-493e4973bd71 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:55.955761 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bcc307e-1122-4d45-8aa8-493e4973bd71 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:55.956193 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bcc307e-1122-4d45-8aa8-493e4973bd71 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:55.956877 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bcc307e-1122-4d45-8aa8-493e4973bd71 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:55.957323 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bcc307e-1122-4d45-8aa8-493e4973bd71 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:55.957768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bcc307e-1122-4d45-8aa8-493e4973bd71 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:55.987960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8bcc307e-1122-4d45-8aa8-493e4973bd71 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045888 Aug 12 06:54:55.988423 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 442/858] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:54:55 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:56.107036 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-75d47f87-7a43-4463-a727-08ce92537118 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:56.108056 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-75d47f87-7a43-4463-a727-08ce92537118 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:56.116206 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-75d47f87-7a43-4463-a727-08ce92537118 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:56.116698 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-75d47f87-7a43-4463-a727-08ce92537118 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:56.117136 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-75d47f87-7a43-4463-a727-08ce92537118 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:56.117838 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-75d47f87-7a43-4463-a727-08ce92537118 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:56.118296 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-75d47f87-7a43-4463-a727-08ce92537118 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:56.118720 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-75d47f87-7a43-4463-a727-08ce92537118 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:56.280271 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-75d47f87-7a43-4463-a727-08ce92537118 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:56.292813 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-75d47f87-7a43-4463-a727-08ce92537118 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1758 microversion: 2.1 time: 0.192003 Aug 12 06:54:56.293696 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 417/859] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:56 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:57.000048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2bf77ba4-0f12-4693-b2b5-872d56ae56c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:57.002276 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2bf77ba4-0f12-4693-b2b5-872d56ae56c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:57.008685 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf77ba4-0f12-4693-b2b5-872d56ae56c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.009157 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf77ba4-0f12-4693-b2b5-872d56ae56c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.009584 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf77ba4-0f12-4693-b2b5-872d56ae56c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:57.010651 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf77ba4-0f12-4693-b2b5-872d56ae56c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.010748 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf77ba4-0f12-4693-b2b5-872d56ae56c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.011199 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf77ba4-0f12-4693-b2b5-872d56ae56c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:57.042401 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2bf77ba4-0f12-4693-b2b5-872d56ae56c7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046195 Aug 12 06:54:57.042912 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 443/860] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:54:56 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 06:54:57.112564 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-368ac5c0-8499-4ede-b046-dcaf5ea7508b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:57.113821 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-368ac5c0-8499-4ede-b046-dcaf5ea7508b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:57.121119 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-368ac5c0-8499-4ede-b046-dcaf5ea7508b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.121614 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-368ac5c0-8499-4ede-b046-dcaf5ea7508b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.122045 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-368ac5c0-8499-4ede-b046-dcaf5ea7508b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:57.122783 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-368ac5c0-8499-4ede-b046-dcaf5ea7508b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.123240 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-368ac5c0-8499-4ede-b046-dcaf5ea7508b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.123936 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-368ac5c0-8499-4ede-b046-dcaf5ea7508b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:57.151364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-368ac5c0-8499-4ede-b046-dcaf5ea7508b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:54:57.235327 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-368ac5c0-8499-4ede-b046-dcaf5ea7508b tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 204 len: 0 microversion: 2.1 time: 0.126391 Aug 12 06:54:57.239757 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 418/861] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:54:57 2022] DELETE /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:54:57.248762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f59e818f-1b06-4cee-adb0-c20d30622467 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:57.250415 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f59e818f-1b06-4cee-adb0-c20d30622467 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:57.259614 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f59e818f-1b06-4cee-adb0-c20d30622467 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.260851 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f59e818f-1b06-4cee-adb0-c20d30622467 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.261347 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f59e818f-1b06-4cee-adb0-c20d30622467 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:57.262108 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f59e818f-1b06-4cee-adb0-c20d30622467 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.262622 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f59e818f-1b06-4cee-adb0-c20d30622467 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.263489 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f59e818f-1b06-4cee-adb0-c20d30622467 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:57.317949 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-caa28b0f-2a7e-4ffb-a869-8c04fe8f229b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:57.318953 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-caa28b0f-2a7e-4ffb-a869-8c04fe8f229b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:57.334121 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-caa28b0f-2a7e-4ffb-a869-8c04fe8f229b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.335738 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-caa28b0f-2a7e-4ffb-a869-8c04fe8f229b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.337331 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-caa28b0f-2a7e-4ffb-a869-8c04fe8f229b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:57.339324 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-caa28b0f-2a7e-4ffb-a869-8c04fe8f229b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.341776 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-caa28b0f-2a7e-4ffb-a869-8c04fe8f229b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.342405 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-caa28b0f-2a7e-4ffb-a869-8c04fe8f229b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:57.555443 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f59e818f-1b06-4cee-adb0-c20d30622467 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:57.564799 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f59e818f-1b06-4cee-adb0-c20d30622467 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1680 microversion: 2.1 time: 0.323275 Aug 12 06:54:57.565754 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 444/862] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:57 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1680 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:57.616343 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-caa28b0f-2a7e-4ffb-a869-8c04fe8f229b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:57.622628 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:54:57.635439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-caa28b0f-2a7e-4ffb-a869-8c04fe8f229b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1758 microversion: 2.1 time: 0.323013 Aug 12 06:54:57.637417 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 419/863] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:57 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1758 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:57.920957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d55a8b17-1633-4723-bac4-6965b2698606 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:57.921584 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d55a8b17-1633-4723-bac4-6965b2698606 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:57.928011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d55a8b17-1633-4723-bac4-6965b2698606 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.928494 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d55a8b17-1633-4723-bac4-6965b2698606 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.928925 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d55a8b17-1633-4723-bac4-6965b2698606 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:57.929638 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d55a8b17-1633-4723-bac4-6965b2698606 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.930069 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d55a8b17-1633-4723-bac4-6965b2698606 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.930607 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d55a8b17-1633-4723-bac4-6965b2698606 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:57.963406 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d55a8b17-1633-4723-bac4-6965b2698606 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments/cb4a1565-87d0-4e97-8da0-fb822511e1be" status: 200 len: 194 microversion: 2.1 time: 0.046750 Aug 12 06:54:57.964143 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 445/864] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Aug 12 06:54:57 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments/cb4a1565-87d0-4e97-8da0-fb822511e1be => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:54:57.976547 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f0574250-b8d1-47a1-8d55-e01749f8801b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:57.977334 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f0574250-b8d1-47a1-8d55-e01749f8801b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:57.988157 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0574250-b8d1-47a1-8d55-e01749f8801b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.988839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0574250-b8d1-47a1-8d55-e01749f8801b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.989357 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0574250-b8d1-47a1-8d55-e01749f8801b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:57.990368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0574250-b8d1-47a1-8d55-e01749f8801b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:57.990920 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0574250-b8d1-47a1-8d55-e01749f8801b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:57.991478 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0574250-b8d1-47a1-8d55-e01749f8801b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:58.093315 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-f0574250-b8d1-47a1-8d55-e01749f8801b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lazy-loading 'services' on Instance uuid 6ec690cd-9235-4c52-95c6-b6f74a37e813 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:54:58.187024 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f0574250-b8d1-47a1-8d55-e01749f8801b tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments/cb4a1565-87d0-4e97-8da0-fb822511e1be" status: 202 len: 0 microversion: 2.1 time: 0.214705 Aug 12 06:54:58.189229 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 420/865] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:54:57 2022] DELETE /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments/cb4a1565-87d0-4e97-8da0-fb822511e1be => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:54:58.596337 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1b4129cd-b926-4721-af44-2ad1eea0f362 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:58.597641 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1b4129cd-b926-4721-af44-2ad1eea0f362 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:58.605123 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b4129cd-b926-4721-af44-2ad1eea0f362 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:58.606025 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b4129cd-b926-4721-af44-2ad1eea0f362 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:58.606701 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b4129cd-b926-4721-af44-2ad1eea0f362 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:58.607760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b4129cd-b926-4721-af44-2ad1eea0f362 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:58.608180 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b4129cd-b926-4721-af44-2ad1eea0f362 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:58.608802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b4129cd-b926-4721-af44-2ad1eea0f362 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:58.662288 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fd2c2333-406a-4c32-90a3-e3051fd592e4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:58.662967 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fd2c2333-406a-4c32-90a3-e3051fd592e4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:58.677534 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd2c2333-406a-4c32-90a3-e3051fd592e4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:58.678015 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd2c2333-406a-4c32-90a3-e3051fd592e4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:58.678437 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd2c2333-406a-4c32-90a3-e3051fd592e4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:58.679162 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd2c2333-406a-4c32-90a3-e3051fd592e4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:58.684739 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd2c2333-406a-4c32-90a3-e3051fd592e4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:58.684739 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fd2c2333-406a-4c32-90a3-e3051fd592e4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:58.829685 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1b4129cd-b926-4721-af44-2ad1eea0f362 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:58.843077 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1b4129cd-b926-4721-af44-2ad1eea0f362 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1680 microversion: 2.1 time: 0.256542 Aug 12 06:54:58.844245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 446/866] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:58 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1680 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:54:58.954783 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fd2c2333-406a-4c32-90a3-e3051fd592e4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:54:58.981745 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fd2c2333-406a-4c32-90a3-e3051fd592e4 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1758 microversion: 2.1 time: 0.323399 Aug 12 06:54:58.982617 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 421/867] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:58 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1758 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:54:59.866018 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-06120ca3-7747-40b1-8dc8-d2f251e98fdf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:54:59.867688 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-06120ca3-7747-40b1-8dc8-d2f251e98fdf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:54:59.880279 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06120ca3-7747-40b1-8dc8-d2f251e98fdf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:59.881371 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06120ca3-7747-40b1-8dc8-d2f251e98fdf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:59.882950 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06120ca3-7747-40b1-8dc8-d2f251e98fdf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:54:59.883889 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06120ca3-7747-40b1-8dc8-d2f251e98fdf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:54:59.885548 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06120ca3-7747-40b1-8dc8-d2f251e98fdf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:54:59.886388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06120ca3-7747-40b1-8dc8-d2f251e98fdf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:00.009149 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-520117fe-911f-4c17-a9d8-63fbf93cf611 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:00.010422 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-520117fe-911f-4c17-a9d8-63fbf93cf611 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:00.016742 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:55:00.023497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-520117fe-911f-4c17-a9d8-63fbf93cf611 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:00.024672 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-520117fe-911f-4c17-a9d8-63fbf93cf611 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:00.025349 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-520117fe-911f-4c17-a9d8-63fbf93cf611 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:00.027126 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-520117fe-911f-4c17-a9d8-63fbf93cf611 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:00.027769 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-520117fe-911f-4c17-a9d8-63fbf93cf611 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:00.028653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-520117fe-911f-4c17-a9d8-63fbf93cf611 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:00.278864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-06120ca3-7747-40b1-8dc8-d2f251e98fdf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:00.291338 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-06120ca3-7747-40b1-8dc8-d2f251e98fdf tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1680 microversion: 2.1 time: 0.424809 Aug 12 06:55:00.292221 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 447/868] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:54:59 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1680 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:00.368835 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-520117fe-911f-4c17-a9d8-63fbf93cf611 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:00.393784 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-520117fe-911f-4c17-a9d8-63fbf93cf611 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1758 microversion: 2.1 time: 0.389717 Aug 12 06:55:00.394872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 422/869] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:00 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1758 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:00.450773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3970e53a-bf0d-4d01-9b52-82d409d27b67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:00.453313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3970e53a-bf0d-4d01-9b52-82d409d27b67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:00.459938 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3970e53a-bf0d-4d01-9b52-82d409d27b67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:00.460673 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3970e53a-bf0d-4d01-9b52-82d409d27b67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:00.461269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3970e53a-bf0d-4d01-9b52-82d409d27b67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:00.462225 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3970e53a-bf0d-4d01-9b52-82d409d27b67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:00.462827 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3970e53a-bf0d-4d01-9b52-82d409d27b67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:00.463423 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3970e53a-bf0d-4d01-9b52-82d409d27b67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:00.494359 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3970e53a-bf0d-4d01-9b52-82d409d27b67 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047444 Aug 12 06:55:00.501132 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 448/870] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:55:00 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 06:55:00.631268 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c494a33f-6180-4bd4-a357-946759addcfc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:00.633815 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c494a33f-6180-4bd4-a357-946759addcfc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:00.640369 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c494a33f-6180-4bd4-a357-946759addcfc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:00.640849 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c494a33f-6180-4bd4-a357-946759addcfc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:00.641540 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c494a33f-6180-4bd4-a357-946759addcfc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:00.642409 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c494a33f-6180-4bd4-a357-946759addcfc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:00.643356 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c494a33f-6180-4bd4-a357-946759addcfc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:00.643952 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c494a33f-6180-4bd4-a357-946759addcfc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:00.700756 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c494a33f-6180-4bd4-a357-946759addcfc tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073472 Aug 12 06:55:00.707924 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 423/871] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:55:00 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 06:55:00.773097 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-53b024d0-3ea6-4100-ae2f-edfc13c361f7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:00.773856 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-53b024d0-3ea6-4100-ae2f-edfc13c361f7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:00.781520 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53b024d0-3ea6-4100-ae2f-edfc13c361f7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:00.782327 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53b024d0-3ea6-4100-ae2f-edfc13c361f7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:00.782924 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53b024d0-3ea6-4100-ae2f-edfc13c361f7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:00.783851 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53b024d0-3ea6-4100-ae2f-edfc13c361f7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:00.784458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53b024d0-3ea6-4100-ae2f-edfc13c361f7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:00.785033 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53b024d0-3ea6-4100-ae2f-edfc13c361f7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:00.843129 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-53b024d0-3ea6-4100-ae2f-edfc13c361f7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:55:00.975085 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-53b024d0-3ea6-4100-ae2f-edfc13c361f7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 204 len: 0 microversion: 2.1 time: 0.206029 Aug 12 06:55:00.976574 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 449/872] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:55:00 2022] DELETE /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:55:00.986661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9ecbe83f-dd6c-4009-a930-addb5d4e54b5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:00.987325 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9ecbe83f-dd6c-4009-a930-addb5d4e54b5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:00.997518 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ecbe83f-dd6c-4009-a930-addb5d4e54b5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:00.998020 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ecbe83f-dd6c-4009-a930-addb5d4e54b5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:00.998459 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ecbe83f-dd6c-4009-a930-addb5d4e54b5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:00.999187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ecbe83f-dd6c-4009-a930-addb5d4e54b5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:00.999643 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ecbe83f-dd6c-4009-a930-addb5d4e54b5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:01.000063 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9ecbe83f-dd6c-4009-a930-addb5d4e54b5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:01.282629 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-46a3428f-ffa3-4d38-ac6b-3901b3c5b026 req-da5bc458-68a2-4ba0-a1a6-cd93a3688704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9145d8-3483-4e57-8350-b4b26927dff1", "name": "network-vif-deleted", "tag": "9be0b6eb-1b87-4534-89f5-a3b7efc1f96d"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:01.290570 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9ecbe83f-dd6c-4009-a930-addb5d4e54b5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:01.299919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9ecbe83f-dd6c-4009-a930-addb5d4e54b5 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1675 microversion: 2.1 time: 0.318286 Aug 12 06:55:01.300943 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-46a3428f-ffa3-4d38-ac6b-3901b3c5b026 req-da5bc458-68a2-4ba0-a1a6-cd93a3688704 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:01.302865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-46a3428f-ffa3-4d38-ac6b-3901b3c5b026 req-da5bc458-68a2-4ba0-a1a6-cd93a3688704 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:01.303539 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-46a3428f-ffa3-4d38-ac6b-3901b3c5b026 req-da5bc458-68a2-4ba0-a1a6-cd93a3688704 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:01.317484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 424/873] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:00 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1675 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:01.324557 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-416f0422-3d38-49e9-9235-7541bcacfc93 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:01.325649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-416f0422-3d38-49e9-9235-7541bcacfc93 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:01.326350 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-46a3428f-ffa3-4d38-ac6b-3901b3c5b026 req-da5bc458-68a2-4ba0-a1a6-cd93a3688704 service nova] Creating event network-vif-deleted:9be0b6eb-1b87-4534-89f5-a3b7efc1f96d for instance da9145d8-3483-4e57-8350-b4b26927dff1 on hv-cinder-84457 Aug 12 06:55:01.333837 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-416f0422-3d38-49e9-9235-7541bcacfc93 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:01.334687 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-416f0422-3d38-49e9-9235-7541bcacfc93 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:01.335291 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-416f0422-3d38-49e9-9235-7541bcacfc93 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:01.336514 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-416f0422-3d38-49e9-9235-7541bcacfc93 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:01.337117 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-416f0422-3d38-49e9-9235-7541bcacfc93 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:01.337687 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-416f0422-3d38-49e9-9235-7541bcacfc93 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:01.341188 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-46a3428f-ffa3-4d38-ac6b-3901b3c5b026 req-da5bc458-68a2-4ba0-a1a6-cd93a3688704 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063162 Aug 12 06:55:01.341831 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 450/874] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:01.407060 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-416f0422-3d38-49e9-9235-7541bcacfc93 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:01.415042 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-416f0422-3d38-49e9-9235-7541bcacfc93 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1613 microversion: 2.1 time: 0.096407 Aug 12 06:55:01.416681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-58298521-27f0-4adf-ba42-8f04ba37f44e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:01.417393 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-58298521-27f0-4adf-ba42-8f04ba37f44e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:01.417607 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 425/875] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:01 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1613 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:01.432283 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58298521-27f0-4adf-ba42-8f04ba37f44e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:01.433080 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58298521-27f0-4adf-ba42-8f04ba37f44e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:01.433669 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58298521-27f0-4adf-ba42-8f04ba37f44e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:01.434553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58298521-27f0-4adf-ba42-8f04ba37f44e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:01.435185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58298521-27f0-4adf-ba42-8f04ba37f44e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:01.435749 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58298521-27f0-4adf-ba42-8f04ba37f44e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:01.895178 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-58298521-27f0-4adf-ba42-8f04ba37f44e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:01.905090 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-58298521-27f0-4adf-ba42-8f04ba37f44e tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1758 microversion: 2.1 time: 0.493221 Aug 12 06:55:01.927370 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 451/876] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:01 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1758 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:55:02.321218 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bc23f1c4-2a04-4ce2-8e26-39ee4efeaed1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:02.322872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bc23f1c4-2a04-4ce2-8e26-39ee4efeaed1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:02.343467 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc23f1c4-2a04-4ce2-8e26-39ee4efeaed1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:02.344331 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc23f1c4-2a04-4ce2-8e26-39ee4efeaed1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:02.345018 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc23f1c4-2a04-4ce2-8e26-39ee4efeaed1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:02.345966 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc23f1c4-2a04-4ce2-8e26-39ee4efeaed1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:02.346577 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc23f1c4-2a04-4ce2-8e26-39ee4efeaed1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:02.347211 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc23f1c4-2a04-4ce2-8e26-39ee4efeaed1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:02.437880 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cfd059bf-b623-4d0f-8b99-dc8fddfb85b0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:02.438562 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cfd059bf-b623-4d0f-8b99-dc8fddfb85b0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:02.446413 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd059bf-b623-4d0f-8b99-dc8fddfb85b0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:02.446897 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd059bf-b623-4d0f-8b99-dc8fddfb85b0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:02.451720 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd059bf-b623-4d0f-8b99-dc8fddfb85b0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:02.452742 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd059bf-b623-4d0f-8b99-dc8fddfb85b0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:02.453201 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd059bf-b623-4d0f-8b99-dc8fddfb85b0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:02.454178 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd059bf-b623-4d0f-8b99-dc8fddfb85b0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:02.513253 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bc23f1c4-2a04-4ce2-8e26-39ee4efeaed1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:02.522218 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bc23f1c4-2a04-4ce2-8e26-39ee4efeaed1 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1675 microversion: 2.1 time: 0.204963 Aug 12 06:55:02.535956 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 426/877] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:02 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:02.557229 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cfd059bf-b623-4d0f-8b99-dc8fddfb85b0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:02.565407 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cfd059bf-b623-4d0f-8b99-dc8fddfb85b0 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1613 microversion: 2.1 time: 0.131332 Aug 12 06:55:02.567481 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 452/878] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:02 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1613 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:02.941540 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-300dab45-5e8e-46c6-bc74-5367520ab798 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:02.942146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-300dab45-5e8e-46c6-bc74-5367520ab798 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:02.948917 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-300dab45-5e8e-46c6-bc74-5367520ab798 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:02.949411 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-300dab45-5e8e-46c6-bc74-5367520ab798 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:02.949842 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-300dab45-5e8e-46c6-bc74-5367520ab798 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:02.950543 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-300dab45-5e8e-46c6-bc74-5367520ab798 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:02.951013 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-300dab45-5e8e-46c6-bc74-5367520ab798 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:02.951430 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-300dab45-5e8e-46c6-bc74-5367520ab798 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:03.173647 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-300dab45-5e8e-46c6-bc74-5367520ab798 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:03.182820 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-300dab45-5e8e-46c6-bc74-5367520ab798 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1758 microversion: 2.1 time: 0.245472 Aug 12 06:55:03.183453 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 427/879] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:02 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1758 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:03.543379 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2dc7ffd6-b91a-4a15-a5fc-3155dc03c4a2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:03.543989 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2dc7ffd6-b91a-4a15-a5fc-3155dc03c4a2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:03.551316 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dc7ffd6-b91a-4a15-a5fc-3155dc03c4a2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:03.551767 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dc7ffd6-b91a-4a15-a5fc-3155dc03c4a2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:03.552192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dc7ffd6-b91a-4a15-a5fc-3155dc03c4a2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:03.552910 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dc7ffd6-b91a-4a15-a5fc-3155dc03c4a2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:03.553528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dc7ffd6-b91a-4a15-a5fc-3155dc03c4a2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:03.553963 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dc7ffd6-b91a-4a15-a5fc-3155dc03c4a2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:03.587909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:03.588753 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:03.597778 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:03.600897 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:03.601559 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:03.602503 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:03.603219 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:03.603848 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:03.671281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:03.671970 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:03.672645 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:03.673238 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lazy-loading 'fault' on Instance uuid da9145d8-3483-4e57-8350-b4b26927dff1 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:55:03.747898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ef719c63d4fbfa5a2a3943bd3b24b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b89f418ef5fd41b39c0a0a36968da428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:03.768455 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b1b58d7a-fb32-427f-8453-e9e1f17016d7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 200 len: 1331 microversion: 2.1 time: 0.184867 Aug 12 06:55:03.769073 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 428/880] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:03 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 1331 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:55:03.814175 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2dc7ffd6-b91a-4a15-a5fc-3155dc03c4a2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:03.830914 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2dc7ffd6-b91a-4a15-a5fc-3155dc03c4a2 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1675 microversion: 2.1 time: 0.291167 Aug 12 06:55:03.833171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 453/881] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:03 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1675 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:04.205091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c5b04646-fb4d-4b77-ae99-0bfdd90a8627 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:04.205712 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c5b04646-fb4d-4b77-ae99-0bfdd90a8627 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:04.213313 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5b04646-fb4d-4b77-ae99-0bfdd90a8627 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:04.213807 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5b04646-fb4d-4b77-ae99-0bfdd90a8627 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:04.214245 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5b04646-fb4d-4b77-ae99-0bfdd90a8627 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:04.215929 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5b04646-fb4d-4b77-ae99-0bfdd90a8627 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:04.216403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5b04646-fb4d-4b77-ae99-0bfdd90a8627 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:04.216840 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5b04646-fb4d-4b77-ae99-0bfdd90a8627 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:04.464255 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c5b04646-fb4d-4b77-ae99-0bfdd90a8627 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:04.474005 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c5b04646-fb4d-4b77-ae99-0bfdd90a8627 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1758 microversion: 2.1 time: 0.272998 Aug 12 06:55:04.475369 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 429/882] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:04 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1758 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:04.790875 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:04.791579 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:04.799858 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:04.800845 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:04.801512 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:04.802604 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:04.803295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:04.803970 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:04.823468 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 HTTP/1.1 Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:04.825619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:04.827054 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': 'da9145d8-3483-4e57-8350-b4b26927dff1'} Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:04.827876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:04.829252 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:04.830662 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:04.830662 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ee4cfd62-6b43-49ab-b59a-b6e620d3a385 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 404 len: 111 microversion: 2.1 time: 0.042145 Aug 12 06:55:04.831095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 454/883] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:04 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:04.837785 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-084bb8e9-8120-484e-b220-5a52dda3ef8c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '.version_select at 0x7fc7046f58b0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:04.855485 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-33107549-ea60-4338-8b3a-02db0f1a934c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:04.857007 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-33107549-ea60-4338-8b3a-02db0f1a934c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:04.884043 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33107549-ea60-4338-8b3a-02db0f1a934c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:04.885373 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33107549-ea60-4338-8b3a-02db0f1a934c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:04.892119 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33107549-ea60-4338-8b3a-02db0f1a934c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:04.894170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-084bb8e9-8120-484e-b220-5a52dda3ef8c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778862283" status: 202 len: 0 microversion: 2.1 time: 0.060071 Aug 12 06:55:04.895578 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33107549-ea60-4338-8b3a-02db0f1a934c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:04.897041 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33107549-ea60-4338-8b3a-02db0f1a934c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:04.898964 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33107549-ea60-4338-8b3a-02db0f1a934c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:04.900149 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 430/884] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Aug 12 06:55:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778862283 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:55:04.914241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-e6f6ff69-1853-4da4-9345-e4b2d6c6dd58 req-faf256b8-e54d-41be-8e24-74bab10ae4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec690cd-9235-4c52-95c6-b6f74a37e813", "name": "network-vif-deleted", "tag": "e7f7943f-2c08-4fad-af7b-e7c8e55bd098"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:04.939383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e6f6ff69-1853-4da4-9345-e4b2d6c6dd58 req-faf256b8-e54d-41be-8e24-74bab10ae4dd service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:04.940203 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e6f6ff69-1853-4da4-9345-e4b2d6c6dd58 req-faf256b8-e54d-41be-8e24-74bab10ae4dd service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:04.940797 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e6f6ff69-1853-4da4-9345-e4b2d6c6dd58 req-faf256b8-e54d-41be-8e24-74bab10ae4dd service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:04.968433 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-e6f6ff69-1853-4da4-9345-e4b2d6c6dd58 req-faf256b8-e54d-41be-8e24-74bab10ae4dd service nova] Creating event network-vif-deleted:e7f7943f-2c08-4fad-af7b-e7c8e55bd098 for instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 on hv-cinder-84457 Aug 12 06:55:04.986261 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-e6f6ff69-1853-4da4-9345-e4b2d6c6dd58 req-faf256b8-e54d-41be-8e24-74bab10ae4dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084653 Aug 12 06:55:04.987183 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 431/885] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:05.060288 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-33107549-ea60-4338-8b3a-02db0f1a934c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c574c32a341a59287de043fa0fe3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953a18a150ee420b908ea4c3665811b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:05.064367 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:55:05.082636 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-33107549-ea60-4338-8b3a-02db0f1a934c tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 200 len: 1607 microversion: 2.1 time: 0.231525 Aug 12 06:55:05.084605 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 455/886] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:04 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 1607 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:05.497061 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8e012295-7580-4d9c-a7a3-f1c258bc6a65 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:05.497956 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8e012295-7580-4d9c-a7a3-f1c258bc6a65 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:05.515641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e012295-7580-4d9c-a7a3-f1c258bc6a65 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:05.516309 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e012295-7580-4d9c-a7a3-f1c258bc6a65 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:05.516854 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e012295-7580-4d9c-a7a3-f1c258bc6a65 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:05.518076 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e012295-7580-4d9c-a7a3-f1c258bc6a65 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:05.518627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e012295-7580-4d9c-a7a3-f1c258bc6a65 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:05.519505 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8e012295-7580-4d9c-a7a3-f1c258bc6a65 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:05.774518 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8e012295-7580-4d9c-a7a3-f1c258bc6a65 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:05.785377 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8e012295-7580-4d9c-a7a3-f1c258bc6a65 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1758 microversion: 2.1 time: 0.293036 Aug 12 06:55:05.799363 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 432/887] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:05 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1758 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:06.104993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:06.105616 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:06.117618 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:06.118103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:06.118532 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:06.119251 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:06.119703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:06.120137 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:06.139351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] HTTP exception thrown: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Request method failure captured: Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 HTTP/1.1 Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9feiEayTqz6iUb09CgktxM0i4IgDo8G2uul27_PIYiExKCW03HqSeZxlgkNU-39g-KazDesmU0TY1ouEdvA1maJhOY5LNw8XgS9Sqcx4jbZj-IsGAyAlS3p0BpzgTSl5YeH9stnGC9CaS670DkXTPeSA0-rqZjy7mUZhJBRzU08lgdM Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:06.141957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_953a18a150ee420b908ea4c3665811b6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 498c574c32a341a59287de043fa0fe3f Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:06.144223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '6ec690cd-9235-4c52-95c6-b6f74a37e813'} Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:06.145055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:06.146402 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:06.149217 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Returning 404 to user: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:06.150780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bfe690c5-92f2-49df-878d-244db2cbb184 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 404 len: 111 microversion: 2.1 time: 0.049686 Aug 12 06:55:06.151840 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 456/888] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:06 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:06.161771 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-79025c54-d913-4bfb-96ac-3f2bc0e3a545 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '.version_select at 0x7fc7046f5d30>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:06.190521 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-79025c54-d913-4bfb-96ac-3f2bc0e3a545 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956231197" status: 202 len: 0 microversion: 2.1 time: 0.032908 Aug 12 06:55:06.192342 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 433/889] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Aug 12 06:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956231197 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:55:06.808049 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-32ca98be-f862-49cf-91a6-5fa016688b8c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:06.808657 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-32ca98be-f862-49cf-91a6-5fa016688b8c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:06.814866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32ca98be-f862-49cf-91a6-5fa016688b8c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:06.815614 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32ca98be-f862-49cf-91a6-5fa016688b8c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:06.816529 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32ca98be-f862-49cf-91a6-5fa016688b8c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:06.817456 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32ca98be-f862-49cf-91a6-5fa016688b8c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:06.818061 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32ca98be-f862-49cf-91a6-5fa016688b8c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:06.818632 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32ca98be-f862-49cf-91a6-5fa016688b8c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:07.102477 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-32ca98be-f862-49cf-91a6-5fa016688b8c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:07.112433 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-32ca98be-f862-49cf-91a6-5fa016688b8c tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1758 microversion: 2.1 time: 0.308645 Aug 12 06:55:07.123825 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 457/890] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:06 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1758 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:07.207687 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:07.208257 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:07.224156 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:07.224604 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:07.225052 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:07.225809 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:07.226438 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:07.226864 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:07.251084 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 HTTP/1.1 Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:07.253064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:07.254390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': 'da9145d8-3483-4e57-8350-b4b26927dff1'} Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:07.255226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:07.256642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:07.259261 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:07.260131 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a6d70886-9977-4a36-8bf9-c148478c96a2 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 404 len: 111 microversion: 2.1 time: 0.057783 Aug 12 06:55:07.260688 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 434/891] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:55:07 2022] DELETE /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:07.269343 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:07.269967 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: da9145d8-3483-4e57-8350-b4b26927dff1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:07.277008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:07.277483 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:07.277913 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:07.278610 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:07.279094 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:07.279514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:07.294966 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 HTTP/1.1 Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:07.296882 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:07.298336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': 'da9145d8-3483-4e57-8350-b4b26927dff1'} Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:07.299949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. Aug 12 06:55:07.301438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:07.302703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance da9145d8-3483-4e57-8350-b4b26927dff1 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:07.302703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-565221b1-9961-4673-b451-666c3835f6a7 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1" status: 404 len: 111 microversion: 2.1 time: 0.033592 Aug 12 06:55:07.302703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 458/892] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:07 2022] GET /compute/v2.1/servers/da9145d8-3483-4e57-8350-b4b26927dff1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:08.135219 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5e2fb40c-cdd1-4af2-8f3a-12ca7fbf88ba tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:08.136243 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5e2fb40c-cdd1-4af2-8f3a-12ca7fbf88ba tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:08.143180 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e2fb40c-cdd1-4af2-8f3a-12ca7fbf88ba tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:08.143748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e2fb40c-cdd1-4af2-8f3a-12ca7fbf88ba tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:08.144254 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e2fb40c-cdd1-4af2-8f3a-12ca7fbf88ba tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:08.145014 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e2fb40c-cdd1-4af2-8f3a-12ca7fbf88ba tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:08.145669 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e2fb40c-cdd1-4af2-8f3a-12ca7fbf88ba tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:08.146287 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e2fb40c-cdd1-4af2-8f3a-12ca7fbf88ba tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:08.359313 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e2fb40c-cdd1-4af2-8f3a-12ca7fbf88ba tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:08.371653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5e2fb40c-cdd1-4af2-8f3a-12ca7fbf88ba tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1761 microversion: 2.1 time: 0.240375 Aug 12 06:55:08.373738 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 435/893] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:08 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1761 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:08.462745 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:08.463296 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:08.470082 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:08.470573 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:08.471037 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:08.471907 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:08.472365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:08.472786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:08.490320 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 HTTP/1.1 Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:08.492313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:55:08.493709 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '337150f7-22b7-4d35-9da2-df74b549b5b2'} Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:08.494515 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:55:08.499424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.502431 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:08.502431 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6e93e7fe-1e4f-4294-a85d-f61346a45be6 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 404 len: 111 microversion: 2.1 time: 0.035977 Aug 12 06:55:08.502431 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 459/894] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:55:08 2022] DELETE /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:08.509559 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:08.510455 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 337150f7-22b7-4d35-9da2-df74b549b5b2] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:08.520771 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:08.521458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:08.522106 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:08.523052 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:08.523513 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:08.523940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:08.538445 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 HTTP/1.1 Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:08.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:55:08.541902 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '337150f7-22b7-4d35-9da2-df74b549b5b2'} Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:08.543039 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. Aug 12 06:55:08.544641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.546235 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance 337150f7-22b7-4d35-9da2-df74b549b5b2 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:08.546235 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7c1dcad3-3df7-4524-a11e-6d3712a87320 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2" status: 404 len: 111 microversion: 2.1 time: 0.037456 Aug 12 06:55:08.550597 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:08.551122 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:08.554367 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 436/895] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:08 2022] GET /compute/v2.1/servers/337150f7-22b7-4d35-9da2-df74b549b5b2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:08.557662 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:08.558152 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:08.558587 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:08.559353 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:08.559810 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:08.560230 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:08.574681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 HTTP/1.1 Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:08.576257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:55:08.578111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '205712a3-060e-4c1a-a2c2-dd9130af8577'} Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:08.578896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:55:08.580763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.582506 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:08.582506 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f7853524-9f2b-496b-a799-0bf4bdb85036 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 404 len: 111 microversion: 2.1 time: 0.031471 Aug 12 06:55:08.582506 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 460/896] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:55:08 2022] DELETE /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:08.587367 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:08.588034 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 205712a3-060e-4c1a-a2c2-dd9130af8577] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:08.594216 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:08.594762 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:08.595219 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:08.595912 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:08.596362 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:08.596782 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:08.610170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 HTTP/1.1 Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:08.611805 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:55:08.613802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '205712a3-060e-4c1a-a2c2-dd9130af8577'} Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:08.614689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. Aug 12 06:55:08.615940 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:08.617000 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance 205712a3-060e-4c1a-a2c2-dd9130af8577 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:08.617000 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3f8f6a3a-9bf0-40a0-bf87-c04dc053833c tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577" status: 404 len: 111 microversion: 2.1 time: 0.030210 Aug 12 06:55:08.617000 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 437/897] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:08 2022] GET /compute/v2.1/servers/205712a3-060e-4c1a-a2c2-dd9130af8577 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 06:55:09.428168 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:09.428881 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:09.435253 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:09.435941 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:09.436539 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:09.437885 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:09.438269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:09.438749 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:09.452900 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] HTTP exception thrown: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Request method failure captured: Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 HTTP/1.1 Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9feiEayTqz6iUb09CgktxM0i4IgDo8G2uul27_PIYiExKCW03HqSeZxlgkNU-39g-KazDesmU0TY1ouEdvA1maJhOY5LNw8XgS9Sqcx4jbZj-IsGAyAlS3p0BpzgTSl5YeH9stnGC9CaS670DkXTPeSA0-rqZjy7mUZhJBRzU08lgdM Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:09.454779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_953a18a150ee420b908ea4c3665811b6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 498c574c32a341a59287de043fa0fe3f Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:09.456444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '6ec690cd-9235-4c52-95c6-b6f74a37e813'} Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:09.457260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:09.458592 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.459920 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Returning 404 to user: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:09.459920 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ed0acfe7-0149-4307-9abb-25835cd4bd44 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 404 len: 111 microversion: 2.1 time: 0.032487 Aug 12 06:55:09.459920 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 461/898] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:55:09 2022] DELETE /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 06:55:09.465276 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:09.465890 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 6ec690cd-9235-4c52-95c6-b6f74a37e813] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:09.472760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:09.473278 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:09.473708 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:09.474400 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:09.474851 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:09.475294 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:09.489577 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] HTTP exception thrown: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Request method failure captured: Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 HTTP/1.1 Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9feiEayTqz6iUb09CgktxM0i4IgDo8G2uul27_PIYiExKCW03HqSeZxlgkNU-39g-KazDesmU0TY1ouEdvA1maJhOY5LNw8XgS9Sqcx4jbZj-IsGAyAlS3p0BpzgTSl5YeH9stnGC9CaS670DkXTPeSA0-rqZjy7mUZhJBRzU08lgdM Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:09.491201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_953a18a150ee420b908ea4c3665811b6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 498c574c32a341a59287de043fa0fe3f Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:09.492723 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '6ec690cd-9235-4c52-95c6-b6f74a37e813'} Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:09.493551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. Aug 12 06:55:09.494919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.496155 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Returning 404 to user: Instance 6ec690cd-9235-4c52-95c6-b6f74a37e813 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:09.496155 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a22a7944-150b-4735-bce2-f8afbcd48685 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813" status: 404 len: 111 microversion: 2.1 time: 0.031327 Aug 12 06:55:09.496155 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 438/899] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:09 2022] GET /compute/v2.1/servers/6ec690cd-9235-4c52-95c6-b6f74a37e813 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:09.761349 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:09.761858 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:09.769662 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:09.770193 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:09.770632 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:09.771326 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:09.772142 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:09.772759 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:09.787885 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 HTTP/1.1 Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:09.789671 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:55:09.791039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '7d5e7e6c-f576-47c1-8fb5-407e318d15c4'} Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:09.795490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:55:09.797013 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.799778 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:09.799778 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-957d34eb-d82d-48bd-8b03-134ebb3d0577 tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 404 len: 111 microversion: 2.1 time: 0.033795 Aug 12 06:55:09.799778 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 462/900] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:55:09 2022] DELETE /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 06:55:09.801125 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:09.802011 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] [instance: 7d5e7e6c-f576-47c1-8fb5-407e318d15c4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:09.814598 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:09.815120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:09.815680 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:09.816396 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:09.816850 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:09.817267 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:09.831570 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] HTTP exception thrown: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Request method failure captured: Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 HTTP/1.1 Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9febVUYTIZ9yd87qXqKZIBFGh_K0HQA9W78JGz4VeDptNa1woU3vP0f2tchHLxmRcDZAGjGJnfGxJ0VB45taNKGFxR6QuEJZwXxn36cFuzSjm4ak0wyaoUmELndcdgZRYHc9Ur-s9MG6SeuZyphjBtc5ELt0Kc6oLXHljg8ROMA2fkw Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:09.833170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b89f418ef5fd41b39c0a0a36968da428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b89f418ef5fd41b39c0a0a36968da428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: b89f418ef5fd41b39c0a0a36968da428 Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73175928 Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 342ef719c63d4fbfa5a2a3943bd3b24b Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeNegativeTest-73175928-project Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:55:09.835120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '7d5e7e6c-f576-47c1-8fb5-407e318d15c4'} Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:09.836027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. Aug 12 06:55:09.837446 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:09.838703 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] Returning 404 to user: Instance 7d5e7e6c-f576-47c1-8fb5-407e318d15c4 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:09.838703 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7e6cd7c3-7631-4f73-91c3-3fa5a40601be tempest-AttachVolumeNegativeTest-73175928 tempest-AttachVolumeNegativeTest-73175928-project] 10.222.0.20 "GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4" status: 404 len: 111 microversion: 2.1 time: 0.038578 Aug 12 06:55:09.838703 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 439/901] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:09 2022] GET /compute/v2.1/servers/7d5e7e6c-f576-47c1-8fb5-407e318d15c4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:10.659116 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:10.659988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:10.666769 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:10.667391 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:10.668314 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:10.669249 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:10.669909 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:10.670539 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:10.685529 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] HTTP exception thrown: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Request method failure captured: Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 HTTP/1.1 Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9feiEayTqz6iUb09CgktxM0i4IgDo8G2uul27_PIYiExKCW03HqSeZxlgkNU-39g-KazDesmU0TY1ouEdvA1maJhOY5LNw8XgS9Sqcx4jbZj-IsGAyAlS3p0BpzgTSl5YeH9stnGC9CaS670DkXTPeSA0-rqZjy7mUZhJBRzU08lgdM Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:10.687100 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_953a18a150ee420b908ea4c3665811b6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 498c574c32a341a59287de043fa0fe3f Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:55:10.688864 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '8c6cd9b2-0e48-4ace-96c2-ba691c366ae1'} Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:10.689760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:55:10.691185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:10.693245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Returning 404 to user: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:10.694241 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4100225a-1f14-480a-8289-6ae2581761a7 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 404 len: 111 microversion: 2.1 time: 0.040356 Aug 12 06:55:10.695340 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 463/902] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:55:10 2022] DELETE /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:10.706290 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:10.707706 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] [instance: 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:10.716763 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:10.717629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:10.718228 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:10.720701 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:10.722814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:10.723445 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:10.743064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] HTTP exception thrown: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Request method failure captured: Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 HTTP/1.1 Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9feiEayTqz6iUb09CgktxM0i4IgDo8G2uul27_PIYiExKCW03HqSeZxlgkNU-39g-KazDesmU0TY1ouEdvA1maJhOY5LNw8XgS9Sqcx4jbZj-IsGAyAlS3p0BpzgTSl5YeH9stnGC9CaS670DkXTPeSA0-rqZjy7mUZhJBRzU08lgdM Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:10.744642 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_953a18a150ee420b908ea4c3665811b6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/953a18a150ee420b908ea4c3665811b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 953a18a150ee420b908ea4c3665811b6 Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1884788706 Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 498c574c32a341a59287de043fa0fe3f Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeTestJSON-1884788706-project Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:55:10.746187 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '8c6cd9b2-0e48-4ace-96c2-ba691c366ae1'} Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:10.746922 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. Aug 12 06:55:10.748403 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:10.749802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] Returning 404 to user: Instance 8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:10.749802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e9e6e416-ca25-4ec1-b829-f20535a1e379 tempest-AttachVolumeTestJSON-1884788706 tempest-AttachVolumeTestJSON-1884788706-project] 10.222.0.20 "GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1" status: 404 len: 111 microversion: 2.1 time: 0.045643 Aug 12 06:55:10.750555 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 440/903] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:10 2022] GET /compute/v2.1/servers/8c6cd9b2-0e48-4ace-96c2-ba691c366ae1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:16.681830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-42418d03-14a1-4bfe-b603-c065732d4aea tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] Action: 'create', calling method: .version_select at 0x7fc704ca3160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2080048149", "metadata": {"Type": "work"}}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:17.000975 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-42418d03-14a1-4bfe-b603-c065732d4aea tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.719521 Aug 12 06:55:17.008055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 464/904] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Aug 12 06:55:16 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 727 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 12 06:55:17.014267 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-34ea8d84-e907-4c0a-af8a-807eae0432e8 tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] Calling method '.version_select at 0x7fc7046450d0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:17.066022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-34ea8d84-e907-4c0a-af8a-807eae0432e8 tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895" status: 200 len: 353 microversion: 2.1 time: 0.055509 Aug 12 06:55:17.066694 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 441/905] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:55:17 2022] GET /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:17.896934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4b7ec0cf-99e6-4a47-9e1c-70e3bfca8b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:17.899554 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4b7ec0cf-99e6-4a47-9e1c-70e3bfca8b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:17.913010 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b7ec0cf-99e6-4a47-9e1c-70e3bfca8b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:17.913497 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b7ec0cf-99e6-4a47-9e1c-70e3bfca8b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:17.913925 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b7ec0cf-99e6-4a47-9e1c-70e3bfca8b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:17.914617 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b7ec0cf-99e6-4a47-9e1c-70e3bfca8b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:17.915097 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b7ec0cf-99e6-4a47-9e1c-70e3bfca8b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:17.915517 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b7ec0cf-99e6-4a47-9e1c-70e3bfca8b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:17.945297 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4b7ec0cf-99e6-4a47-9e1c-70e3bfca8b0a tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053074 Aug 12 06:55:17.945877 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 465/906] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Aug 12 06:55:17 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:18.029552 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ddfaa705-11e7-4765-b395-766d5b060d93 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:18.030159 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ddfaa705-11e7-4765-b395-766d5b060d93 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:18.036368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddfaa705-11e7-4765-b395-766d5b060d93 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:18.036862 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddfaa705-11e7-4765-b395-766d5b060d93 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:18.037298 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddfaa705-11e7-4765-b395-766d5b060d93 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:18.038009 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddfaa705-11e7-4765-b395-766d5b060d93 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:18.038458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddfaa705-11e7-4765-b395-766d5b060d93 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:18.038877 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ddfaa705-11e7-4765-b395-766d5b060d93 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:18.068126 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ddfaa705-11e7-4765-b395-766d5b060d93 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:55:18.081215 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c679a0a6-8fc9-45f1-abdc-17fbee4ad5a9 tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] Calling method '.version_select at 0x7fc704d56040>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:18.107624 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:55:18.164339 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ddfaa705-11e7-4765-b395-766d5b060d93 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 204 len: 0 microversion: 2.20 time: 0.139347 Aug 12 06:55:18.171059 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 442/907] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Aug 12 06:55:18 2022] DELETE /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 06:55:18.172737 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c679a0a6-8fc9-45f1-abdc-17fbee4ad5a9 tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895" status: 200 len: 354 microversion: 2.1 time: 0.096233 Aug 12 06:55:18.173530 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 466/908] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:55:18 2022] GET /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895 => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:18.177981 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:18.178676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:18.186814 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:18.187330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:18.187496 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-10a077a7-92b9-4866-81d0-02aa882f0319 tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] Calling method '.version_select at 0x7fc704cbbd30>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:18.187757 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:18.188553 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:18.188998 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:18.189408 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:18.246473 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-10a077a7-92b9-4866-81d0-02aa882f0319 tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895" status: 200 len: 354 microversion: 2.1 time: 0.063527 Aug 12 06:55:18.247481 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 467/909] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:55:18 2022] GET /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895 => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:18.259893 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dc52bf85-5bda-49db-87ba-b30078a72bd7 tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] Calling method '.version_select at 0x7fc704cd9310>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:18.332070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dc52bf85-5bda-49db-87ba-b30078a72bd7 tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895" status: 202 len: 0 microversion: 2.1 time: 0.076000 Aug 12 06:55:18.332849 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 468/910] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 06:55:18 2022] DELETE /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 06:55:18.342454 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5076480a-8e07-4296-8001-4dd6f9f00390 tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] Calling method '.version_select at 0x7fc704d214c0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:18.397926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5076480a-8e07-4296-8001-4dd6f9f00390 tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895" status: 200 len: 353 microversion: 2.1 time: 0.059582 Aug 12 06:55:18.398496 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 469/911] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:55:18 2022] GET /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:18.438108 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:18.452017 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:18.454028 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:18.455603 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-30ac6226-115e-481d-b4cd-519f4e04bb33 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.282815 Aug 12 06:55:18.456553 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 443/912] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:55:18 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:55:19.413182 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d12bd876-ae24-45ad-8f59-75043d1eda3b tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] Calling method '.version_select at 0x7fc704d56f70>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:19.444891 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-d12bd876-ae24-45ad-8f59-75043d1eda3b tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] HTTP exception thrown: Volume 5d3020af-f9df-4ef6-b802-55edbc344895 could not be found. Aug 12 06:55:19.479247 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:19.479844 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:19.487062 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:19.487605 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:19.488091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:19.489003 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:19.489649 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:19.490134 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d12bd876-ae24-45ad-8f59-75043d1eda3b tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] Request method failure captured: Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895 HTTP/1.1 Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9flUVj5GOHeHkAaa8M_QZQM9m1KDUSiuIfkSZlyKy7mBudhG_2cx1ZHQvfkPnJWYmf3r9HnxA2Le654mvAGoodIuqIO4iUaRCNlApMOiPOHoIL5ECxkxFOHeWHpAFIY6FVp2JMh9WXZj4_yQs1BQg2ZxXo2ADsnJlTxTK3-7-1PsrII Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: ab4f7bc551034cddaa6d99c190c470be Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesGetTestJSON-685422261 Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:19.523504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4f7bc551034cddaa6d99c190c470be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4f7bc551034cddaa6d99c190c470be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4f7bc551034cddaa6d99c190c470be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4f7bc551034cddaa6d99c190c470be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesGetTestJSON-685422261 Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: ab4f7bc551034cddaa6d99c190c470be Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesGetTestJSON-685422261 Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesGetTestJSON-685422261-project Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 08d054a5fab1454fa5698240b8d56f48 Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesGetTestJSON-685422261-project Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Volume 5d3020af-f9df-4ef6-b802-55edbc344895 could not be found. Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '5d3020af-f9df-4ef6-b802-55edbc344895'} Aug 12 06:55:19.524977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5d3020af-f9df-4ef6-b802-55edbc344895 could not be found. (HTTP 404) (Request-ID: req-205b8f1f-b6e2-4876-84de-d34a24f6c354) Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:19.525922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 06:55:19.527295 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5d3020af-f9df-4ef6-b802-55edbc344895 could not be found. Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 06:55:19.528721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:19.530436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5d3020af-f9df-4ef6-b802-55edbc344895 could not be found. Aug 12 06:55:19.530436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:19.530436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:19.530436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:19.530436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:19.530436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:19.530436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:19.530436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:19.530436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:19.530436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5d3020af-f9df-4ef6-b802-55edbc344895 could not be found. Aug 12 06:55:19.530436 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:19.543257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d12bd876-ae24-45ad-8f59-75043d1eda3b tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] Returning 404 to user: Volume 5d3020af-f9df-4ef6-b802-55edbc344895 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:19.544361 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d12bd876-ae24-45ad-8f59-75043d1eda3b tempest-VolumesGetTestJSON-685422261 tempest-VolumesGetTestJSON-685422261-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895" status: 404 len: 109 microversion: 2.1 time: 0.136475 Aug 12 06:55:19.545123 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 470/913] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:55:19 2022] GET /compute/v2.1/os-volumes/5d3020af-f9df-4ef6-b802-55edbc344895 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:19.645337 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:19.654485 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:19.656022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:19.657250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a9d3b0a7-599d-4815-8de8-23847b4603b3 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1726 microversion: 2.20 time: 0.182361 Aug 12 06:55:19.668087 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 444/914] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:55:19 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 06:55:20.679853 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:20.680460 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:20.692250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:55:20.695002 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:20.695659 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:20.696445 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:20.697358 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:20.698016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:20.699002 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:20.797435 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-589da1c2-5df6-4566-b279-423fb61dc7e7 req-c4e85594-6dc1-433f-8e26-feb11602e95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0893bde6-8eaf-4ca0-95bb-0c04c57e158e", "name": "network-vif-deleted", "tag": "4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:20.826458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-589da1c2-5df6-4566-b279-423fb61dc7e7 req-c4e85594-6dc1-433f-8e26-feb11602e95b service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:20.827676 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-589da1c2-5df6-4566-b279-423fb61dc7e7 req-c4e85594-6dc1-433f-8e26-feb11602e95b service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:20.832597 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-589da1c2-5df6-4566-b279-423fb61dc7e7 req-c4e85594-6dc1-433f-8e26-feb11602e95b service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:20.876430 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-589da1c2-5df6-4566-b279-423fb61dc7e7 req-c4e85594-6dc1-433f-8e26-feb11602e95b service nova] Creating event network-vif-deleted:4ac6fd9c-6b4a-4ffb-a629-b3f111b37dcc for instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e on hv-cinder-84457 Aug 12 06:55:20.902334 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-589da1c2-5df6-4566-b279-423fb61dc7e7 req-c4e85594-6dc1-433f-8e26-feb11602e95b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109891 Aug 12 06:55:20.906697 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 445/915] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:55:20.924766 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:20.940192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:20.950540 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f4a5b4ebab2440faab418f58b87942f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f03ba37e3ca430d8f7777a28b2819d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:20.953386 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a23a1af1-2963-4068-99cc-c8889e0101ed tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 200 len: 1658 microversion: 2.20 time: 0.277864 Aug 12 06:55:20.957248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 471/916] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:55:20 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 1658 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 06:55:21.984326 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:21.985811 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:21.997328 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:22.003467 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:22.004120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:22.005158 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:22.007119 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:22.007734 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:22.042277 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] HTTP exception thrown: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Request method failure captured: Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e HTTP/1.1 Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9fehQS08eVeSs8c_ZbM5y2ty1SWri2ObrC6X3SMBZekwjzd4U_BMyBmByRCugl1I0lKWdLIF6yPas4HE5GCdOZV-hBFeA32kKwK_i-t5DdEwU0m-IZKMjuS-eOBtDNsWQTvhsbzFgHnmAScZXV7yAACDAIvxYQKuoaWsrIrRI9gDkHc Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:22.044802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f03ba37e3ca430d8f7777a28b2819d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 4f4a5b4ebab2440faab418f58b87942f Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:22.046544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '0893bde6-8eaf-4ca0-95bb-0c04c57e158e'} Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:22.047396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:22.048660 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.051836 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Returning 404 to user: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:22.053107 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4c48a918-d83e-45ea-8440-076ae07d6bba tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 404 len: 111 microversion: 2.20 time: 0.073749 Aug 12 06:55:22.058253 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 472/917] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:55:21 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 06:55:22.066643 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c013565f-41d5-4608-898a-18c7e8e005b8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '.version_select at 0x7fc704ca3160>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:22.089169 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c013565f-41d5-4608-898a-18c7e8e005b8 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455843163" status: 204 len: 0 microversion: 2.20 time: 0.028827 Aug 12 06:55:22.095395 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 473/918] 10.222.0.20 () {60 vars in 1262 bytes} [Fri Aug 12 06:55:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455843163 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 06:55:22.149069 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-139c7903-37ba-49a5-bde9-7cd9bd980641 tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Action: 'create', calling method: .version_select at 0x7fc7045dbd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-813524826", "metadata": {"Type": "work"}}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-139c7903-37ba-49a5-bde9-7cd9bd980641 tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Request method failure captured: Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 121 Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9flZRZDGKQtnmN_x_dwbbYKhQY0OYa9pLCs4OxQmJ5YIHs7W6H9rLobWAWn0i3YGZWg0KiPfw_HK3bUHsYKW26AC-Uvw_oedAQDli3380F4vd-k1Nn9iOCOs8i4VroYKRYc1AMxzB8AByEqmUs0uGb__Qjvk0cuU47SM10hL9gSoDeg Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:22.166678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_762e59d0c9514cca9717f183f8d3a5df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: a113581a8bc441d5b7bdd6035bd5e73a Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-813524826", "metadata": {"Type": "work"}}} Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: Aug 12 06:55:22.168748 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-813524826', 'metadata': {'Type': 'work'}}}} Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise error Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi '#$%' Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:22.170497 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 06:55:22.172027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 06:55:22.173408 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 06:55:22.173408 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.176088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-139c7903-37ba-49a5-bde9-7cd9bd980641 tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:22.177317 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-139c7903-37ba-49a5-bde9-7cd9bd980641 tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.273949 Aug 12 06:55:22.178122 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 446/919] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Aug 12 06:55:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 276 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 06:55:22.189570 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d4a20c0d-89ae-49ca-a928-0f5409fe811e tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Action: 'create', calling method: .version_select at 0x7fc704c715e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1730381442", "metadata": {"Type": "work"}}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d4a20c0d-89ae-49ca-a928-0f5409fe811e tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Request method failure captured: Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 120 Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9flZRZDGKQtnmN_x_dwbbYKhQY0OYa9pLCs4OxQmJ5YIHs7W6H9rLobWAWn0i3YGZWg0KiPfw_HK3bUHsYKW26AC-Uvw_oedAQDli3380F4vd-k1Nn9iOCOs8i4VroYKRYc1AMxzB8AByEqmUs0uGb__Qjvk0cuU47SM10hL9gSoDeg Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:22.194630 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_762e59d0c9514cca9717f183f8d3a5df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: a113581a8bc441d5b7bdd6035bd5e73a Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1730381442", "metadata": {"Type": "work"}}} Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: Aug 12 06:55:22.196452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1730381442', 'metadata': {'Type': 'work'}}}} Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise error Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi '0' Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:22.197245 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 06:55:22.198560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 06:55:22.199772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 06:55:22.199772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.199772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d4a20c0d-89ae-49ca-a928-0f5409fe811e tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:22.199772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d4a20c0d-89ae-49ca-a928-0f5409fe811e tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012285 Aug 12 06:55:22.210068 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7b0e92f4-5675-4760-bc24-ed9f0003c9c0 tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Action: 'create', calling method: .version_select at 0x7fc704577040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1298318198", "metadata": {"Type": "work"}}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:22.214275 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 474/920] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Aug 12 06:55:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7b0e92f4-5675-4760-bc24-ed9f0003c9c0 tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Request method failure captured: Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 119 Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9flZRZDGKQtnmN_x_dwbbYKhQY0OYa9pLCs4OxQmJ5YIHs7W6H9rLobWAWn0i3YGZWg0KiPfw_HK3bUHsYKW26AC-Uvw_oedAQDli3380F4vd-k1Nn9iOCOs8i4VroYKRYc1AMxzB8AByEqmUs0uGb__Qjvk0cuU47SM10hL9gSoDeg Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:22.216264 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_762e59d0c9514cca9717f183f8d3a5df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: a113581a8bc441d5b7bdd6035bd5e73a Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1298318198", "metadata": {"Type": "work"}}} Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: Aug 12 06:55:22.217928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1298318198', 'metadata': {'Type': 'work'}}}} Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise error Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi '' Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:22.218921 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 06:55:22.220660 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 06:55:22.222051 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 06:55:22.222051 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.224412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7b0e92f4-5675-4760-bc24-ed9f0003c9c0 tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:22.225579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7b0e92f4-5675-4760-bc24-ed9f0003c9c0 tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019572 Aug 12 06:55:22.226718 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 447/921] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Aug 12 06:55:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 06:55:22.238995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a71bc852-3e6d-4ec2-83d6-62e45f9b458f tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Calling method '.version_select at 0x7fc704d48d30>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:22.292606 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-a71bc852-3e6d-4ec2-83d6-62e45f9b458f tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] HTTP exception thrown: Volume tempest-invalid-1177555372 could not be found. Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a71bc852-3e6d-4ec2-83d6-62e45f9b458f tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Request method failure captured: Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1177555372 HTTP/1.1 Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9flZRZDGKQtnmN_x_dwbbYKhQY0OYa9pLCs4OxQmJ5YIHs7W6H9rLobWAWn0i3YGZWg0KiPfw_HK3bUHsYKW26AC-Uvw_oedAQDli3380F4vd-k1Nn9iOCOs8i4VroYKRYc1AMxzB8AByEqmUs0uGb__Qjvk0cuU47SM10hL9gSoDeg Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:22.295011 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_762e59d0c9514cca9717f183f8d3a5df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: a113581a8bc441d5b7bdd6035bd5e73a Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Volume tempest-invalid-1177555372 could not be found. Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': 'tempest-invalid-1177555372'} Aug 12 06:55:22.296553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1177555372 could not be found. (HTTP 404) (Request-ID: req-674f64f5-bfac-4b4c-81c0-0cd1d79e28ff) Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.297552 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 06:55:22.299095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1177555372 could not be found. Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:22.300388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1177555372 could not be found. Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1177555372 could not be found. Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a71bc852-3e6d-4ec2-83d6-62e45f9b458f tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Returning 404 to user: Volume tempest-invalid-1177555372 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a71bc852-3e6d-4ec2-83d6-62e45f9b458f tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1177555372" status: 404 len: 99 microversion: 2.1 time: 0.064012 Aug 12 06:55:22.301753 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 475/922] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Aug 12 06:55:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1177555372 => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 12 06:55:22.311818 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b84b6df6-7831-4c25-857c-9f0678f4c99f tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004065 Aug 12 06:55:22.318855 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 448/923] 10.222.0.20 () {58 vars in 1140 bytes} [Fri Aug 12 06:55:22 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 12 06:55:22.329470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ed29e40d-c0fa-49c1-a265-24abc078c0c5 tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009032 Aug 12 06:55:22.333351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 476/924] 10.222.0.20 () {58 vars in 1137 bytes} [Fri Aug 12 06:55:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 12 06:55:22.346129 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7f920e78-96f2-42d7-a472-755ea823ce5d tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Calling method '.version_select at 0x7fc7046233a0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:22.386713 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-7f920e78-96f2-42d7-a472-755ea823ce5d tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] HTTP exception thrown: Volume 80f7ec82-b60b-4f56-a664-0170e8f18b44 could not be found. Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7f920e78-96f2-42d7-a472-755ea823ce5d tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Request method failure captured: Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/os-volumes/80f7ec82-b60b-4f56-a664-0170e8f18b44 HTTP/1.1 Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9flZRZDGKQtnmN_x_dwbbYKhQY0OYa9pLCs4OxQmJ5YIHs7W6H9rLobWAWn0i3YGZWg0KiPfw_HK3bUHsYKW26AC-Uvw_oedAQDli3380F4vd-k1Nn9iOCOs8i4VroYKRYc1AMxzB8AByEqmUs0uGb__Qjvk0cuU47SM10hL9gSoDeg Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:22.390097 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_762e59d0c9514cca9717f183f8d3a5df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: a113581a8bc441d5b7bdd6035bd5e73a Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Volume 80f7ec82-b60b-4f56-a664-0170e8f18b44 could not be found. Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '80f7ec82-b60b-4f56-a664-0170e8f18b44'} Aug 12 06:55:22.391790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80f7ec82-b60b-4f56-a664-0170e8f18b44 could not be found. (HTTP 404) (Request-ID: req-b1d2338a-7a6e-46a9-81b6-3a8f84b3e2a7) Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.393622 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 06:55:22.395613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80f7ec82-b60b-4f56-a664-0170e8f18b44 could not be found. Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 06:55:22.397242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80f7ec82-b60b-4f56-a664-0170e8f18b44 could not be found. Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80f7ec82-b60b-4f56-a664-0170e8f18b44 could not be found. Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7f920e78-96f2-42d7-a472-755ea823ce5d tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Returning 404 to user: Volume 80f7ec82-b60b-4f56-a664-0170e8f18b44 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7f920e78-96f2-42d7-a472-755ea823ce5d tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/80f7ec82-b60b-4f56-a664-0170e8f18b44" status: 404 len: 109 microversion: 2.1 time: 0.053985 Aug 12 06:55:22.399170 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 449/925] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 06:55:22 2022] DELETE /compute/v2.1/os-volumes/80f7ec82-b60b-4f56-a664-0170e8f18b44 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:22.407746 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c9729356-6278-4291-aea5-db0eca688b4c tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Calling method '.version_select at 0x7fc704ca3280>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:22.443583 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-c9729356-6278-4291-aea5-db0eca688b4c tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] HTTP exception thrown: Volume 60b476fb-8493-4bce-bfdf-2bc5124d007b could not be found. Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c9729356-6278-4291-aea5-db0eca688b4c tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Request method failure captured: Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/os-volumes/60b476fb-8493-4bce-bfdf-2bc5124d007b HTTP/1.1 Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9flZRZDGKQtnmN_x_dwbbYKhQY0OYa9pLCs4OxQmJ5YIHs7W6H9rLobWAWn0i3YGZWg0KiPfw_HK3bUHsYKW26AC-Uvw_oedAQDli3380F4vd-k1Nn9iOCOs8i4VroYKRYc1AMxzB8AByEqmUs0uGb__Qjvk0cuU47SM10hL9gSoDeg Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:22.447380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_762e59d0c9514cca9717f183f8d3a5df", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/762e59d0c9514cca9717f183f8d3a5df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 762e59d0c9514cca9717f183f8d3a5df Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesNegativeTest-1916463655 Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: a113581a8bc441d5b7bdd6035bd5e73a Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesNegativeTest-1916463655-project Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Volume 60b476fb-8493-4bce-bfdf-2bc5124d007b could not be found. Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '60b476fb-8493-4bce-bfdf-2bc5124d007b'} Aug 12 06:55:22.448728 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60b476fb-8493-4bce-bfdf-2bc5124d007b could not be found. (HTTP 404) (Request-ID: req-9793caf8-81f0-49c2-a5f7-a282010ebca7) Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.449531 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 06:55:22.450679 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60b476fb-8493-4bce-bfdf-2bc5124d007b could not be found. Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 06:55:22.452571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60b476fb-8493-4bce-bfdf-2bc5124d007b could not be found. Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60b476fb-8493-4bce-bfdf-2bc5124d007b could not be found. Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c9729356-6278-4291-aea5-db0eca688b4c tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] Returning 404 to user: Volume 60b476fb-8493-4bce-bfdf-2bc5124d007b could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c9729356-6278-4291-aea5-db0eca688b4c tempest-VolumesNegativeTest-1916463655 tempest-VolumesNegativeTest-1916463655-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/60b476fb-8493-4bce-bfdf-2bc5124d007b" status: 404 len: 109 microversion: 2.1 time: 0.046030 Aug 12 06:55:22.454726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 477/926] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:55:22 2022] GET /compute/v2.1/os-volumes/60b476fb-8493-4bce-bfdf-2bc5124d007b => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:24.752056 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:24.754249 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:24.767008 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:24.768297 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:24.770015 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:24.771381 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:24.771985 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:24.772606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:24.792297 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] HTTP exception thrown: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Request method failure captured: Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e HTTP/1.1 Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fehQS08eVeSs8c_ZbM5y2ty1SWri2ObrC6X3SMBZekwjzd4U_BMyBmByRCugl1I0lKWdLIF6yPas4HE5GCdOZV-hBFeA32kKwK_i-t5DdEwU0m-IZKMjuS-eOBtDNsWQTvhsbzFgHnmAScZXV7yAACDAIvxYQKuoaWsrIrRI9gDkHc Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:24.794176 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f03ba37e3ca430d8f7777a28b2819d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 4f4a5b4ebab2440faab418f58b87942f Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:24.795973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '0893bde6-8eaf-4ca0-95bb-0c04c57e158e'} Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:24.796872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:24.798423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:24.801148 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Returning 404 to user: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:24.802773 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d174ad1a-9cbc-412e-83b3-7c5ac6768423 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 404 len: 111 microversion: 2.20 time: 0.057524 Aug 12 06:55:24.803530 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 450/927] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Aug 12 06:55:24 2022] DELETE /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 06:55:24.814164 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:24.817725 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: 0893bde6-8eaf-4ca0-95bb-0c04c57e158e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:24.832583 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:24.833173 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:24.833670 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:24.834441 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:24.834956 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:24.835478 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:24.856843 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] HTTP exception thrown: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Request method failure captured: Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e HTTP/1.1 Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9fehQS08eVeSs8c_ZbM5y2ty1SWri2ObrC6X3SMBZekwjzd4U_BMyBmByRCugl1I0lKWdLIF6yPas4HE5GCdOZV-hBFeA32kKwK_i-t5DdEwU0m-IZKMjuS-eOBtDNsWQTvhsbzFgHnmAScZXV7yAACDAIvxYQKuoaWsrIrRI9gDkHc Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:24.858488 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f03ba37e3ca430d8f7777a28b2819d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 4f4a5b4ebab2440faab418f58b87942f Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:24.860269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '0893bde6-8eaf-4ca0-95bb-0c04c57e158e'} Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:24.861171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. Aug 12 06:55:24.862681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:24.867712 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Returning 404 to user: Instance 0893bde6-8eaf-4ca0-95bb-0c04c57e158e could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:24.867712 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9c61dc75-84d3-4bcd-b292-6e2df4682f7d tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e" status: 404 len: 111 microversion: 2.20 time: 0.052324 Aug 12 06:55:24.867712 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 478/928] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:55:24 2022] GET /compute/v2.1/servers/0893bde6-8eaf-4ca0-95bb-0c04c57e158e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 06:55:26.070475 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:26.071663 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:26.081648 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:26.083506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:26.084381 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:26.086188 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:26.086889 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:26.087611 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:26.108749 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] HTTP exception thrown: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Request method failure captured: Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 HTTP/1.1 Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fehQS08eVeSs8c_ZbM5y2ty1SWri2ObrC6X3SMBZekwjzd4U_BMyBmByRCugl1I0lKWdLIF6yPas4HE5GCdOZV-hBFeA32kKwK_i-t5DdEwU0m-IZKMjuS-eOBtDNsWQTvhsbzFgHnmAScZXV7yAACDAIvxYQKuoaWsrIrRI9gDkHc Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:26.110787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f03ba37e3ca430d8f7777a28b2819d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 4f4a5b4ebab2440faab418f58b87942f Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:55:26.112316 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': 'a6bc12e0-d758-47a7-920d-971a6e993711'} Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:26.113072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:55:26.114275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:26.116579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Returning 404 to user: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:26.116579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4d165eb8-5617-4087-9625-7443e455ec07 tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 404 len: 111 microversion: 2.20 time: 0.046630 Aug 12 06:55:26.116579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 451/929] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Aug 12 06:55:26 2022] DELETE /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 06:55:26.123677 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:26.124923 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] [instance: a6bc12e0-d758-47a7-920d-971a6e993711] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:26.137754 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:26.138444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:26.139070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:26.139907 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:26.140494 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:26.141179 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:26.160801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] HTTP exception thrown: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Request method failure captured: Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 HTTP/1.1 Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9fehQS08eVeSs8c_ZbM5y2ty1SWri2ObrC6X3SMBZekwjzd4U_BMyBmByRCugl1I0lKWdLIF6yPas4HE5GCdOZV-hBFeA32kKwK_i-t5DdEwU0m-IZKMjuS-eOBtDNsWQTvhsbzFgHnmAScZXV7yAACDAIvxYQKuoaWsrIrRI9gDkHc Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:26.163762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f03ba37e3ca430d8f7777a28b2819d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f03ba37e3ca430d8f7777a28b2819d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 9f03ba37e3ca430d8f7777a28b2819d3 Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-322107509 Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 4f4a5b4ebab2440faab418f58b87942f Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-322107509-project Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:55:26.165372 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': 'a6bc12e0-d758-47a7-920d-971a6e993711'} Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:26.166272 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. Aug 12 06:55:26.178403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:26.189724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] Returning 404 to user: Instance a6bc12e0-d758-47a7-920d-971a6e993711 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:26.189724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-323c2591-fa15-4b92-924e-bb27cebe1c7b tempest-AttachVolumeShelveTestJSON-322107509 tempest-AttachVolumeShelveTestJSON-322107509-project] 10.222.0.20 "GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711" status: 404 len: 111 microversion: 2.20 time: 0.048944 Aug 12 06:55:26.189724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 479/930] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 06:55:26 2022] GET /compute/v2.1/servers/a6bc12e0-d758-47a7-920d-971a6e993711 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 06:55:34.804796 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cb6df092-a6c8-47d3-ad47-d5752013b320 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Action: 'create', calling method: .version_select at 0x7fc7051ed160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-271553105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1V5kJKIMNO55rI2kyWBRrIAWUteBGsIa9nnSV0CDIXqR+CG0Q2u4Q80FJZz/jypUaXp8LgEaZd0t9cDA+romAiFKlzH+eb48sah+uHQRb+WyEQZytxeL22KtsaqZwCBA=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:34.810561 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:55:34.828084 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-cb6df092-a6c8-47d3-ad47-d5752013b320 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Getting quotas for project 64466d34729c44908afad2679c99d439. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:55:34.833541 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-cb6df092-a6c8-47d3-ad47-d5752013b320 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Getting quotas for user 5138389f1535438d8380cf6cc9bd891b and project 64466d34729c44908afad2679c99d439. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:55:34.869433 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cb6df092-a6c8-47d3-ad47-d5752013b320 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.314099 Aug 12 06:55:34.870116 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 452/931] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 06:55:34 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:55:35.346024 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0f51c72b-47ac-4eb5-a473-68b8fbc731fa tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Action: 'create', calling method: .version_select at 0x7fc705170700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1331243551"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:36.102147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0f51c72b-47ac-4eb5-a473-68b8fbc731fa tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.156040 Aug 12 06:55:36.104783 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 480/932] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Aug 12 06:55:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1159 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 12 06:55:36.119186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f4ebdd27-6dfd-4f2f-b9ef-92f65787e695 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc704893160>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:36.149179 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:55:36.219956 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f4ebdd27-6dfd-4f2f-b9ef-92f65787e695 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed" status: 200 len: 345 microversion: 2.1 time: 0.105330 Aug 12 06:55:36.220561 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 453/933] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:55:36 2022] GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:37.233452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a0e969b2-fec3-4621-909b-68cf5c0ed197 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc704c74a60>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:37.241611 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:55:37.242596 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=39 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:55:37.301173 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a0e969b2-fec3-4621-909b-68cf5c0ed197 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed" status: 200 len: 346 microversion: 2.1 time: 0.071345 Aug 12 06:55:37.301802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 481/934] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:55:37 2022] GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:37.319470 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-766845cb-1cc7-4b43-8f5e-de3ae7a2047a tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Action: 'create', calling method: .version_select at 0x7fc704858820>, body: {"snapshot": {"volume_id": "55b07f83-32df-466b-9a8a-255eddf7c9ed", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1134767672"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:37.565380 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-766845cb-1cc7-4b43-8f5e-de3ae7a2047a tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.250136 Aug 12 06:55:37.566246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 454/935] 10.222.0.20 () {60 vars in 1162 bytes} [Fri Aug 12 06:55:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:37.578164 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a489bd62-ff22-405c-8346-dbfe9ffdd7a8 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc704ca3310>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:37.633575 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a489bd62-ff22-405c-8346-dbfe9ffdd7a8 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10" status: 200 len: 287 microversion: 2.1 time: 0.059792 Aug 12 06:55:37.634144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 482/936] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 06:55:37 2022] GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:37.646422 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-37cff765-ed45-4c4d-af8e-847fb3586308 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc7051ed280>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:37.767957 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-37cff765-ed45-4c4d-af8e-847fb3586308 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.126263 Aug 12 06:55:37.768524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 455/937] 10.222.0.20 () {58 vars in 1140 bytes} [Fri Aug 12 06:55:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:37.779888 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4f532ac9-3b8b-47f1-8e6c-1f22351bdef6 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc704d21e50>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:37.873866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4f532ac9-3b8b-47f1-8e6c-1f22351bdef6 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10" status: 200 len: 287 microversion: 2.1 time: 0.098157 Aug 12 06:55:37.874393 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 483/938] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 06:55:37 2022] GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:38.886276 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bc1bb878-f18b-412c-80d7-fd8ccfc1c21e tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc7045dba60>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:38.923825 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bc1bb878-f18b-412c-80d7-fd8ccfc1c21e tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10" status: 200 len: 287 microversion: 2.1 time: 0.041932 Aug 12 06:55:38.924526 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 456/939] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 06:55:38 2022] GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:55:39.939631 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-33f5b083-233b-47a9-a374-a36e7325708a tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc704c76ca0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:39.971823 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-33f5b083-233b-47a9-a374-a36e7325708a tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10" status: 200 len: 287 microversion: 2.1 time: 0.038085 Aug 12 06:55:39.972796 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 484/940] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 06:55:39 2022] GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:40.986090 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f3b7ea9e-e44f-4fe5-97b2-5273ac55a43d tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc7048b5b80>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:41.018548 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f3b7ea9e-e44f-4fe5-97b2-5273ac55a43d tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10" status: 200 len: 288 microversion: 2.1 time: 0.036839 Aug 12 06:55:41.019420 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 457/941] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 06:55:40 2022] GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10 => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:41.032351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fcf3e1ff-2300-4bf6-8d6e-860b583c66ee tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc704d0d5e0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:41.123311 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fcf3e1ff-2300-4bf6-8d6e-860b583c66ee tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10" status: 202 len: 0 microversion: 2.1 time: 0.095284 Aug 12 06:55:41.123880 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 485/942] 10.222.0.20 () {58 vars in 1254 bytes} [Fri Aug 12 06:55:41 2022] DELETE /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:55:41.132106 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-099917cf-4d10-404c-ac2a-04b7c4edeff9 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc7051ed280>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:41.162493 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-099917cf-4d10-404c-ac2a-04b7c4edeff9 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10" status: 200 len: 287 microversion: 2.1 time: 0.034120 Aug 12 06:55:41.163229 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 458/943] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 06:55:41 2022] GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:41.459754 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-828d3164-4cb1-4421-a532-94db43585de3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1844616839"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:41.460367 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-828d3164-4cb1-4421-a532-94db43585de3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:41.469142 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d3164-4cb1-4421-a532-94db43585de3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:41.469908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d3164-4cb1-4421-a532-94db43585de3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:41.470333 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d3164-4cb1-4421-a532-94db43585de3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:41.471051 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d3164-4cb1-4421-a532-94db43585de3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:41.471500 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d3164-4cb1-4421-a532-94db43585de3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:41.471943 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-828d3164-4cb1-4421-a532-94db43585de3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:41.615668 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.network.security_group_api [None req-828d3164-4cb1-4421-a532-94db43585de3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Removing security group 185e0e81-f306-492c-a774-d8fa5730388c from port 96a99562-8ad9-44c6-b596-af4b26f087ae Aug 12 06:55:41.963934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-828d3164-4cb1-4421-a532-94db43585de3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "POST /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/action" status: 202 len: 0 microversion: 2.1 time: 0.508469 Aug 12 06:55:41.964983 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 486/944] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:55:41 2022] POST /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:55:41.973345 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-4a1009a8-0dbb-43c1-9f9c-8aeb3535f223 req-b77c7be7-34be-4cb0-8ab2-c225782955d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f087d0a-dd24-4db2-9492-7d2ff7a5d63d", "tag": "96a99562-8ad9-44c6-b596-af4b26f087ae"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:41.984433 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4a1009a8-0dbb-43c1-9f9c-8aeb3535f223 req-b77c7be7-34be-4cb0-8ab2-c225782955d6 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:41.985391 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4a1009a8-0dbb-43c1-9f9c-8aeb3535f223 req-b77c7be7-34be-4cb0-8ab2-c225782955d6 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:41.986068 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4a1009a8-0dbb-43c1-9f9c-8aeb3535f223 req-b77c7be7-34be-4cb0-8ab2-c225782955d6 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:41.997843 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-4a1009a8-0dbb-43c1-9f9c-8aeb3535f223 req-b77c7be7-34be-4cb0-8ab2-c225782955d6 service nova] Creating event network-changed:96a99562-8ad9-44c6-b596-af4b26f087ae for instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d on hv-cinder-84457 Aug 12 06:55:42.009208 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-4a1009a8-0dbb-43c1-9f9c-8aeb3535f223 req-b77c7be7-34be-4cb0-8ab2-c225782955d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039466 Aug 12 06:55:42.010792 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 459/945] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:42.177824 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0fa4126b-acdd-4382-89db-61a551fbf3b3 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc704d0da60>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:42.229874 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-0fa4126b-acdd-4382-89db-61a551fbf3b3 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] HTTP exception thrown: Snapshot aa5cda32-f86d-45bb-8ad5-1efaaf913c10 could not be found. Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0fa4126b-acdd-4382-89db-61a551fbf3b3 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Request method failure captured: Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10 HTTP/1.1 Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9flmOb4OUqZjfVUbI4GWaNyPxtEWo7zFOZf78UV8mTccjU1VSJtIAIrk-WVX2Wpat2LDILjfSbE6Xa04dzlO9PfDVw0XF0aIP80-tmVDGwmlPD1tOvWLsojdL8KR5Xnw6LHt-_4Z7hnvX1NjcG8CnPaU2CiVmRRGfl8XnJsg4R8CVbc Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: adafd9aa6b124eca819e8d7e797ac699 Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:42.233501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adafd9aa6b124eca819e8d7e797ac699", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: adafd9aa6b124eca819e8d7e797ac699 Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesSnapshotsTestJSON-876014164-project Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 67b632581daa4dc7875c4d2b2766d8a5 Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesSnapshotsTestJSON-876014164-project Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Snapshot aa5cda32-f86d-45bb-8ad5-1efaaf913c10 could not be found. Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': 'aa5cda32-f86d-45bb-8ad5-1efaaf913c10'} Aug 12 06:55:42.235050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot aa5cda32-f86d-45bb-8ad5-1efaaf913c10 could not be found. (HTTP 404) (Request-ID: req-dbfaef06-4b08-4c9b-8c5c-b8d18a101f9e) Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:42.236256 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 06:55:42.237714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot aa5cda32-f86d-45bb-8ad5-1efaaf913c10 could not be found. Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 12 06:55:42.239211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:42.240785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot aa5cda32-f86d-45bb-8ad5-1efaaf913c10 could not be found. Aug 12 06:55:42.240785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:42.240785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:42.240785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:42.240785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:42.240785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:42.240785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:42.240785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:42.240785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:42.240785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot aa5cda32-f86d-45bb-8ad5-1efaaf913c10 could not be found. Aug 12 06:55:42.240785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:42.248032 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0fa4126b-acdd-4382-89db-61a551fbf3b3 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Returning 404 to user: Snapshot aa5cda32-f86d-45bb-8ad5-1efaaf913c10 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:42.248309 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0fa4126b-acdd-4382-89db-61a551fbf3b3 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10" status: 404 len: 111 microversion: 2.1 time: 0.075723 Aug 12 06:55:42.249460 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 487/946] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 06:55:42 2022] GET /compute/v2.1/os-snapshots/aa5cda32-f86d-45bb-8ad5-1efaaf913c10 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:42.258009 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0e8bb1de-1898-4970-b9b8-7068be8515ab tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc7051ed160>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:42.388320 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0e8bb1de-1898-4970-b9b8-7068be8515ab tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed" status: 202 len: 0 microversion: 2.1 time: 0.134485 Aug 12 06:55:42.389093 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 460/947] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 06:55:42 2022] DELETE /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:55:42.399277 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9e04a046-3ee5-4ab3-9d76-d1180124a224 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc704c74ee0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:42.479293 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9e04a046-3ee5-4ab3-9d76-d1180124a224 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed" status: 200 len: 345 microversion: 2.1 time: 0.084692 Aug 12 06:55:42.480095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 488/948] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:55:42 2022] GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:43.232997 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-590f70f2-46a1-405e-8465-fede3f7357d3 req-e8a4e0ce-e7e6-42b0-975f-247cb00223ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f087d0a-dd24-4db2-9492-7d2ff7a5d63d", "tag": "96a99562-8ad9-44c6-b596-af4b26f087ae"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:43.234963 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-baed9684-ce4e-49d5-9420-ca69eb307451 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:43.235719 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-baed9684-ce4e-49d5-9420-ca69eb307451 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:43.244960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-590f70f2-46a1-405e-8465-fede3f7357d3 req-e8a4e0ce-e7e6-42b0-975f-247cb00223ec service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:43.245434 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-590f70f2-46a1-405e-8465-fede3f7357d3 req-e8a4e0ce-e7e6-42b0-975f-247cb00223ec service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:43.245859 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-590f70f2-46a1-405e-8465-fede3f7357d3 req-e8a4e0ce-e7e6-42b0-975f-247cb00223ec service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:43.249679 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-baed9684-ce4e-49d5-9420-ca69eb307451 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:43.250641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-baed9684-ce4e-49d5-9420-ca69eb307451 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:43.252889 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-baed9684-ce4e-49d5-9420-ca69eb307451 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:43.254006 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-baed9684-ce4e-49d5-9420-ca69eb307451 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:43.254862 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-baed9684-ce4e-49d5-9420-ca69eb307451 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:43.255719 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-baed9684-ce4e-49d5-9420-ca69eb307451 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:43.257278 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-590f70f2-46a1-405e-8465-fede3f7357d3 req-e8a4e0ce-e7e6-42b0-975f-247cb00223ec service nova] Creating event network-changed:96a99562-8ad9-44c6-b596-af4b26f087ae for instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d on hv-cinder-84457 Aug 12 06:55:43.262720 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-590f70f2-46a1-405e-8465-fede3f7357d3 req-e8a4e0ce-e7e6-42b0-975f-247cb00223ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034076 Aug 12 06:55:43.263601 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 489/949] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:43.347845 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-baed9684-ce4e-49d5-9420-ca69eb307451 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lazy-loading 'services' on Instance uuid 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:55:43.429779 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-baed9684-ce4e-49d5-9420-ca69eb307451 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/os-volume_attachments/1cb5089e-da11-48f5-97f4-d56481db484b" status: 202 len: 0 microversion: 2.1 time: 0.205588 Aug 12 06:55:43.430433 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 461/950] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:55:43 2022] DELETE /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/os-volume_attachments/1cb5089e-da11-48f5-97f4-d56481db484b => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:55:43.440273 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-963688b4-6d7e-430f-b60a-85d73096e1d2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:43.442969 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-963688b4-6d7e-430f-b60a-85d73096e1d2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:43.449726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963688b4-6d7e-430f-b60a-85d73096e1d2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:43.450550 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963688b4-6d7e-430f-b60a-85d73096e1d2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:43.451298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963688b4-6d7e-430f-b60a-85d73096e1d2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:43.452137 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963688b4-6d7e-430f-b60a-85d73096e1d2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:43.452680 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963688b4-6d7e-430f-b60a-85d73096e1d2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:43.453368 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963688b4-6d7e-430f-b60a-85d73096e1d2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:43.487307 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-963688b4-6d7e-430f-b60a-85d73096e1d2 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051521 Aug 12 06:55:43.488091 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 490/951] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:55:43 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:55:43.494295 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d70f7023-7ccf-42fe-b572-f604f1f7ead5 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc704858790>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:43.528349 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-d70f7023-7ccf-42fe-b572-f604f1f7ead5 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] HTTP exception thrown: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d70f7023-7ccf-42fe-b572-f604f1f7ead5 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Request method failure captured: Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed HTTP/1.1 Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9flmOb4OUqZjfVUbI4GWaNyPxtEWo7zFOZf78UV8mTccjU1VSJtIAIrk-WVX2Wpat2LDILjfSbE6Xa04dzlO9PfDVw0XF0aIP80-tmVDGwmlPD1tOvWLsojdL8KR5Xnw6LHt-_4Z7hnvX1NjcG8CnPaU2CiVmRRGfl8XnJsg4R8CVbc Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: adafd9aa6b124eca819e8d7e797ac699 Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:43.531080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adafd9aa6b124eca819e8d7e797ac699", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: adafd9aa6b124eca819e8d7e797ac699 Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesSnapshotsTestJSON-876014164-project Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 67b632581daa4dc7875c4d2b2766d8a5 Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesSnapshotsTestJSON-876014164-project Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '55b07f83-32df-466b-9a8a-255eddf7c9ed'} Aug 12 06:55:43.532653 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. (HTTP 404) (Request-ID: req-c5eb13e5-1f2b-4b81-8a3e-391fa0ee61b4) Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:43.533661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 06:55:43.534867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 06:55:43.536150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d70f7023-7ccf-42fe-b572-f604f1f7ead5 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Returning 404 to user: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d70f7023-7ccf-42fe-b572-f604f1f7ead5 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed" status: 404 len: 109 microversion: 2.1 time: 0.042432 Aug 12 06:55:43.537441 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 462/952] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:55:43 2022] GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:43.549092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d180d75f-9962-4bf7-ba87-508875b16d41 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc704c194c0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:43.583880 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-d180d75f-9962-4bf7-ba87-508875b16d41 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] HTTP exception thrown: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d180d75f-9962-4bf7-ba87-508875b16d41 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Request method failure captured: Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed HTTP/1.1 Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9flmOb4OUqZjfVUbI4GWaNyPxtEWo7zFOZf78UV8mTccjU1VSJtIAIrk-WVX2Wpat2LDILjfSbE6Xa04dzlO9PfDVw0XF0aIP80-tmVDGwmlPD1tOvWLsojdL8KR5Xnw6LHt-_4Z7hnvX1NjcG8CnPaU2CiVmRRGfl8XnJsg4R8CVbc Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: adafd9aa6b124eca819e8d7e797ac699 Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:43.586449 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adafd9aa6b124eca819e8d7e797ac699", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: adafd9aa6b124eca819e8d7e797ac699 Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesSnapshotsTestJSON-876014164-project Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 67b632581daa4dc7875c4d2b2766d8a5 Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesSnapshotsTestJSON-876014164-project Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '55b07f83-32df-466b-9a8a-255eddf7c9ed'} Aug 12 06:55:43.588089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. (HTTP 404) (Request-ID: req-e1f9c412-75d4-4d2f-ae2c-9f5d13d905dd) Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:43.589183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 06:55:43.590640 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 06:55:43.592329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:43.595378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.595378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.595378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:43.595378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.595378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.595378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:43.595378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:43.595378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:43.595378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:43.595378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.595378 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.597573 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d180d75f-9962-4bf7-ba87-508875b16d41 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Returning 404 to user: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:43.598597 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d180d75f-9962-4bf7-ba87-508875b16d41 tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed" status: 404 len: 109 microversion: 2.1 time: 0.055365 Aug 12 06:55:43.600433 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 491/953] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 06:55:43 2022] DELETE /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:43.607674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-15eb35ea-f9dc-4fde-959b-7ba4c6f306ef tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Calling method '.version_select at 0x7fc7051eddc0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:43.637471 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-15eb35ea-f9dc-4fde-959b-7ba4c6f306ef tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] HTTP exception thrown: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-15eb35ea-f9dc-4fde-959b-7ba4c6f306ef tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Request method failure captured: Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed HTTP/1.1 Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9flmOb4OUqZjfVUbI4GWaNyPxtEWo7zFOZf78UV8mTccjU1VSJtIAIrk-WVX2Wpat2LDILjfSbE6Xa04dzlO9PfDVw0XF0aIP80-tmVDGwmlPD1tOvWLsojdL8KR5Xnw6LHt-_4Z7hnvX1NjcG8CnPaU2CiVmRRGfl8XnJsg4R8CVbc Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: adafd9aa6b124eca819e8d7e797ac699 Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:43.639456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adafd9aa6b124eca819e8d7e797ac699", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adafd9aa6b124eca819e8d7e797ac699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: adafd9aa6b124eca819e8d7e797ac699 Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-876014164 Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesSnapshotsTestJSON-876014164-project Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 67b632581daa4dc7875c4d2b2766d8a5 Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesSnapshotsTestJSON-876014164-project Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '55b07f83-32df-466b-9a8a-255eddf7c9ed'} Aug 12 06:55:43.640824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. (HTTP 404) (Request-ID: req-68718fa9-7c42-45a8-887d-3c8a6e0c5a33) Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:43.641629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 06:55:43.644146 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 06:55:43.646399 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-15eb35ea-f9dc-4fde-959b-7ba4c6f306ef tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] Returning 404 to user: Volume 55b07f83-32df-466b-9a8a-255eddf7c9ed could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-15eb35ea-f9dc-4fde-959b-7ba4c6f306ef tempest-VolumesSnapshotsTestJSON-876014164 tempest-VolumesSnapshotsTestJSON-876014164-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed" status: 404 len: 109 microversion: 2.1 time: 0.042488 Aug 12 06:55:43.648443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 463/954] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 06:55:43 2022] GET /compute/v2.1/os-volumes/55b07f83-32df-466b-9a8a-255eddf7c9ed => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:44.501201 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ba9139e4-6c6b-4deb-8446-b593bee3f496 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:44.504686 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ba9139e4-6c6b-4deb-8446-b593bee3f496 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:44.512922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba9139e4-6c6b-4deb-8446-b593bee3f496 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:44.513658 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba9139e4-6c6b-4deb-8446-b593bee3f496 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:44.514290 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba9139e4-6c6b-4deb-8446-b593bee3f496 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:44.515284 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba9139e4-6c6b-4deb-8446-b593bee3f496 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:44.516557 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba9139e4-6c6b-4deb-8446-b593bee3f496 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:44.517649 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba9139e4-6c6b-4deb-8446-b593bee3f496 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:44.559544 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ba9139e4-6c6b-4deb-8446-b593bee3f496 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062850 Aug 12 06:55:44.572032 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:44.575771 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:44.579287 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 492/955] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 06:55:44 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 06:55:44.583715 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:44.584387 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:44.585022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:44.586216 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:44.586967 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:44.587635 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:44.674613 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] HTTP exception thrown: Instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d is not attached to volume 1cb5089e-da11-48f5-97f4-d56481db484b Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Request method failure captured: Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/os-volume_attachments/1cb5089e-da11-48f5-97f4-d56481db484b HTTP/1.1 Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fjlinJf3GBxeUB9Q_UT3x9UMRnWUjJv5GBSO2tWh8yABw50or0M25B-CCo47T3oxT_-ArCv5lPBEKlAdTa5yHspF2MXdujnPo-X5uulh7G8Y1e-ZJbPENvWyN73MAQuM-ZmaCNBF6t8NuOzoPugOF3y0Olz0B74SifnMJ3zGJGAMCQ Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: a5bda0f141e844dcae39d3a687543744 Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-TestMinimumBasicScenario-1887315620 Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:55:44.681839 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:55:44.683269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a5bda0f141e844dcae39d3a687543744", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a5bda0f141e844dcae39d3a687543744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a5bda0f141e844dcae39d3a687543744"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a5bda0f141e844dcae39d3a687543744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:44.683269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-TestMinimumBasicScenario-1887315620 Aug 12 06:55:44.683269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: a5bda0f141e844dcae39d3a687543744 Aug 12 06:55:44.683269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1887315620 Aug 12 06:55:44.683269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-TestMinimumBasicScenario-1887315620-project Aug 12 06:55:44.683269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:55:44.683269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:55:44.683269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: f6a076962b774301a7c9530db7579943 Aug 12 06:55:44.683269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-TestMinimumBasicScenario-1887315620-project Aug 12 06:55:44.683269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:55:44.683269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d is not attached to volume 1cb5089e-da11-48f5-97f4-d56481db484b Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'server_id': '5f087d0a-dd24-4db2-9492-7d2ff7a5d63d', 'id': '1cb5089e-da11-48f5-97f4-d56481db484b'} Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1cb5089e-da11-48f5-97f4-d56481db484b. Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:44.684166 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d is not attached to volume 1cb5089e-da11-48f5-97f4-d56481db484b Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d is not attached to volume 1cb5089e-da11-48f5-97f4-d56481db484b Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:55:44.685348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Returning 404 to user: Instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d is not attached to volume 1cb5089e-da11-48f5-97f4-d56481db484b {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:44.686344 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a02d2feb-8629-45cf-b425-69fcdf432aa3 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/os-volume_attachments/1cb5089e-da11-48f5-97f4-d56481db484b" status: 404 len: 154 microversion: 2.1 time: 0.116201 Aug 12 06:55:44.686344 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 464/956] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 06:55:44 2022] DELETE /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d/os-volume_attachments/1cb5089e-da11-48f5-97f4-d56481db484b => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:45.873350 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4a43d1ba-8f24-42ce-9fb7-13370966350b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:45.873826 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4a43d1ba-8f24-42ce-9fb7-13370966350b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:45.880629 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a43d1ba-8f24-42ce-9fb7-13370966350b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:45.881108 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a43d1ba-8f24-42ce-9fb7-13370966350b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:45.881535 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a43d1ba-8f24-42ce-9fb7-13370966350b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:45.882425 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a43d1ba-8f24-42ce-9fb7-13370966350b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:45.883109 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a43d1ba-8f24-42ce-9fb7-13370966350b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:45.883719 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a43d1ba-8f24-42ce-9fb7-13370966350b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:45.925789 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4a43d1ba-8f24-42ce-9fb7-13370966350b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:55:46.218103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4a43d1ba-8f24-42ce-9fb7-13370966350b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 204 len: 0 microversion: 2.1 time: 0.348253 Aug 12 06:55:46.219905 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 493/957] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:55:45 2022] DELETE /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:55:46.230905 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fc5eb7ab-f8ce-4f7a-9934-e269da81919b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:46.232040 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fc5eb7ab-f8ce-4f7a-9934-e269da81919b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:46.234490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=4 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:55:46.241490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc5eb7ab-f8ce-4f7a-9934-e269da81919b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:46.242109 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc5eb7ab-f8ce-4f7a-9934-e269da81919b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:46.242651 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc5eb7ab-f8ce-4f7a-9934-e269da81919b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:46.243866 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc5eb7ab-f8ce-4f7a-9934-e269da81919b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:46.244453 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc5eb7ab-f8ce-4f7a-9934-e269da81919b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:46.245383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fc5eb7ab-f8ce-4f7a-9934-e269da81919b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:46.491634 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fc5eb7ab-f8ce-4f7a-9934-e269da81919b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:46.507868 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fc5eb7ab-f8ce-4f7a-9934-e269da81919b tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1555 microversion: 2.1 time: 0.283328 Aug 12 06:55:46.509267 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 465/958] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:46 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1555 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:47.530233 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e7149c5d-b3e9-4cb1-bb7c-d70b1d3031c7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:47.531017 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e7149c5d-b3e9-4cb1-bb7c-d70b1d3031c7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:47.541384 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7149c5d-b3e9-4cb1-bb7c-d70b1d3031c7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:47.542441 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7149c5d-b3e9-4cb1-bb7c-d70b1d3031c7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:47.543162 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7149c5d-b3e9-4cb1-bb7c-d70b1d3031c7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:47.545365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7149c5d-b3e9-4cb1-bb7c-d70b1d3031c7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:47.546309 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7149c5d-b3e9-4cb1-bb7c-d70b1d3031c7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:47.547042 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7149c5d-b3e9-4cb1-bb7c-d70b1d3031c7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:47.773681 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e7149c5d-b3e9-4cb1-bb7c-d70b1d3031c7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:47.784566 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e7149c5d-b3e9-4cb1-bb7c-d70b1d3031c7 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1555 microversion: 2.1 time: 0.258280 Aug 12 06:55:47.785197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 494/959] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:47 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:55:48.810563 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cbfc06b0-b53a-4552-abe5-96a1bd239223 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:48.811243 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cbfc06b0-b53a-4552-abe5-96a1bd239223 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:48.826534 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-917704e2-e900-4bb4-9267-bbba6c71d434 req-301979c0-a457-47c4-9e7d-c3563b6c059f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f087d0a-dd24-4db2-9492-7d2ff7a5d63d", "name": "network-vif-deleted", "tag": "96a99562-8ad9-44c6-b596-af4b26f087ae"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:55:48.833504 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbfc06b0-b53a-4552-abe5-96a1bd239223 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:48.839298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-917704e2-e900-4bb4-9267-bbba6c71d434 req-301979c0-a457-47c4-9e7d-c3563b6c059f service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:48.839770 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-917704e2-e900-4bb4-9267-bbba6c71d434 req-301979c0-a457-47c4-9e7d-c3563b6c059f service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:48.840193 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-917704e2-e900-4bb4-9267-bbba6c71d434 req-301979c0-a457-47c4-9e7d-c3563b6c059f service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:48.841364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbfc06b0-b53a-4552-abe5-96a1bd239223 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:48.841976 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbfc06b0-b53a-4552-abe5-96a1bd239223 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:48.842694 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbfc06b0-b53a-4552-abe5-96a1bd239223 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:48.843210 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbfc06b0-b53a-4552-abe5-96a1bd239223 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:48.843651 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbfc06b0-b53a-4552-abe5-96a1bd239223 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:48.875138 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-917704e2-e900-4bb4-9267-bbba6c71d434 req-301979c0-a457-47c4-9e7d-c3563b6c059f service nova] Creating event network-vif-deleted:96a99562-8ad9-44c6-b596-af4b26f087ae for instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d on hv-cinder-84457 Aug 12 06:55:48.897634 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-917704e2-e900-4bb4-9267-bbba6c71d434 req-301979c0-a457-47c4-9e7d-c3563b6c059f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074129 Aug 12 06:55:48.898683 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 495/960] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:55:48.943306 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cbfc06b0-b53a-4552-abe5-96a1bd239223 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a076962b774301a7c9530db7579943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bda0f141e844dcae39d3a687543744', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:55:48.952325 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cbfc06b0-b53a-4552-abe5-96a1bd239223 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 200 len: 1513 microversion: 2.1 time: 0.149955 Aug 12 06:55:48.965614 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 466/961] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:48 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:55:49.974489 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:49.975119 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] [instance: 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:55:49.983291 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:49.983830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:49.984441 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:49.985144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:55:49.985594 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:55:49.986010 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:55:49.999355 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] HTTP exception thrown: Instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d could not be found. Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Request method failure captured: Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d HTTP/1.1 Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9fjlinJf3GBxeUB9Q_UT3x9UMRnWUjJv5GBSO2tWh8yABw50or0M25B-CCo47T3oxT_-ArCv5lPBEKlAdTa5yHspF2MXdujnPo-X5uulh7G8Y1e-ZJbPENvWyN73MAQuM-ZmaCNBF6t8NuOzoPugOF3y0Olz0B74SifnMJ3zGJGAMCQ Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: a5bda0f141e844dcae39d3a687543744 Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestMinimumBasicScenario-1887315620 Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 06:55:50.000993 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a5bda0f141e844dcae39d3a687543744", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a5bda0f141e844dcae39d3a687543744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a5bda0f141e844dcae39d3a687543744"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a5bda0f141e844dcae39d3a687543744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestMinimumBasicScenario-1887315620 Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: a5bda0f141e844dcae39d3a687543744 Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1887315620 Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-TestMinimumBasicScenario-1887315620-project Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: f6a076962b774301a7c9530db7579943 Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestMinimumBasicScenario-1887315620-project Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d could not be found. Aug 12 06:55:50.002374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '5f087d0a-dd24-4db2-9492-7d2ff7a5d63d'} Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d could not be found. Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:55:50.003388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d could not be found. Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d could not be found. Aug 12 06:55:50.004591 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 06:55:50.005695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Returning 404 to user: Instance 5f087d0a-dd24-4db2-9492-7d2ff7a5d63d could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:55:50.005695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ebbb1863-2ca5-4062-83b8-23717b094127 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d" status: 404 len: 111 microversion: 2.1 time: 0.033089 Aug 12 06:55:50.005695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 496/962] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:55:49 2022] GET /compute/v2.1/servers/5f087d0a-dd24-4db2-9492-7d2ff7a5d63d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:55:50.011624 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3e7705e4-db65-4db9-b578-fbdef8b07656 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] Calling method '.version_select at 0x7fc7046ed160>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:55:50.032180 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3e7705e4-db65-4db9-b578-fbdef8b07656 tempest-TestMinimumBasicScenario-1887315620 tempest-TestMinimumBasicScenario-1887315620-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1446519245" status: 202 len: 0 microversion: 2.1 time: 0.024382 Aug 12 06:55:50.032789 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 467/963] 10.222.0.20 () {58 vars in 1272 bytes} [Fri Aug 12 06:55:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1446519245 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:56:01.725205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1185352947", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-271553105", "security_groups": [{"name": "tempest-secgroup-smoke-2135118312"}], "block_device_mapping_v2": [{"uuid": "361af7a6-95a4-473d-a7da-5f5a60bfeb01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8101570f-07e2-43c5-a2c5-9493f86335a2"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:01.735215 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:01.735856 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:01.850549 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] validate_networks() for [('8101570f-07e2-43c5-a2c5-9493f86335a2', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:56:02.233480 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:56:02.233896 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:56:02.234361 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:56:02.234809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:56:02.235242 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:56:02.244619 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:02.245772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:02.246205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:02.247165 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:02.248257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:02.248569 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:02.266236 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Getting quotas for project 64466d34729c44908afad2679c99d439. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:56:02.270632 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Getting quotas for user 5138389f1535438d8380cf6cc9bd891b and project 64466d34729c44908afad2679c99d439. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:56:02.332120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:56:02.334369 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='361af7a6-95a4-473d-a7da-5f5a60bfeb01',volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:56:02.473149 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-486c9b9d-422c-4e87-90ce-4e557c230d82 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751876 Aug 12 06:56:02.473996 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 497/964] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:56:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:56:02.485571 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-48066aec-083c-494b-a157-228ba88160a4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:02.486303 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-48066aec-083c-494b-a157-228ba88160a4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:02.489929 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:02.490536 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:02.559951 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-48066aec-083c-494b-a157-228ba88160a4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:02.566825 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-48066aec-083c-494b-a157-228ba88160a4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1094 microversion: 2.1 time: 0.085623 Aug 12 06:56:02.568281 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 468/965] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:02 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:56:03.589726 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-06b794dd-b86f-4ea5-aea1-a3c8711bce1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:03.591463 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-06b794dd-b86f-4ea5-aea1-a3c8711bce1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:03.599567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06b794dd-b86f-4ea5-aea1-a3c8711bce1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:03.600423 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06b794dd-b86f-4ea5-aea1-a3c8711bce1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:03.601424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06b794dd-b86f-4ea5-aea1-a3c8711bce1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:03.602337 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06b794dd-b86f-4ea5-aea1-a3c8711bce1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:03.603426 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06b794dd-b86f-4ea5-aea1-a3c8711bce1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:03.603913 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-06b794dd-b86f-4ea5-aea1-a3c8711bce1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:03.681645 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-06b794dd-b86f-4ea5-aea1-a3c8711bce1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:03.693430 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-06b794dd-b86f-4ea5-aea1-a3c8711bce1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1200 microversion: 2.1 time: 0.108716 Aug 12 06:56:03.695547 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 498/966] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:03 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1200 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:04.720209 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e76cbc44-9824-4647-9ce7-cb081abae164 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:04.722291 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e76cbc44-9824-4647-9ce7-cb081abae164 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:04.729715 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e76cbc44-9824-4647-9ce7-cb081abae164 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:04.730464 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e76cbc44-9824-4647-9ce7-cb081abae164 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:04.731164 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e76cbc44-9824-4647-9ce7-cb081abae164 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:04.732076 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e76cbc44-9824-4647-9ce7-cb081abae164 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:04.732587 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e76cbc44-9824-4647-9ce7-cb081abae164 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:04.733190 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e76cbc44-9824-4647-9ce7-cb081abae164 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:04.974223 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e76cbc44-9824-4647-9ce7-cb081abae164 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:04.983321 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e76cbc44-9824-4647-9ce7-cb081abae164 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1266 microversion: 2.1 time: 0.267228 Aug 12 06:56:04.984031 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 469/967] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:04 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:05.261786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-9f5c4f1c-28b9-4aec-90d5-bef37e51b5fd req-709392e0-494c-41eb-b703-6138da84156d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a9065d-a53f-4325-b7eb-a0aad221c075", "tag": "f93c3d68-b767-428a-9306-42ffdec5cf15"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:05.283451 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9f5c4f1c-28b9-4aec-90d5-bef37e51b5fd req-709392e0-494c-41eb-b703-6138da84156d service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:05.284050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9f5c4f1c-28b9-4aec-90d5-bef37e51b5fd req-709392e0-494c-41eb-b703-6138da84156d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:05.284610 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9f5c4f1c-28b9-4aec-90d5-bef37e51b5fd req-709392e0-494c-41eb-b703-6138da84156d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:05.309179 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-9f5c4f1c-28b9-4aec-90d5-bef37e51b5fd req-709392e0-494c-41eb-b703-6138da84156d service nova] Creating event network-changed:f93c3d68-b767-428a-9306-42ffdec5cf15 for instance 86a9065d-a53f-4325-b7eb-a0aad221c075 on hv-cinder-84457 Aug 12 06:56:05.320960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-9f5c4f1c-28b9-4aec-90d5-bef37e51b5fd req-709392e0-494c-41eb-b703-6138da84156d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064279 Aug 12 06:56:05.325742 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 499/968] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:56:06.004638 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5fbd9b7a-7f75-4421-8921-60da7a34fbd7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:06.006157 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5fbd9b7a-7f75-4421-8921-60da7a34fbd7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:06.012795 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5fbd9b7a-7f75-4421-8921-60da7a34fbd7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:06.013313 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5fbd9b7a-7f75-4421-8921-60da7a34fbd7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:06.013734 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5fbd9b7a-7f75-4421-8921-60da7a34fbd7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:06.014428 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5fbd9b7a-7f75-4421-8921-60da7a34fbd7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:06.015072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5fbd9b7a-7f75-4421-8921-60da7a34fbd7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:06.015490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5fbd9b7a-7f75-4421-8921-60da7a34fbd7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:06.239219 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5fbd9b7a-7f75-4421-8921-60da7a34fbd7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:06.253009 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5fbd9b7a-7f75-4421-8921-60da7a34fbd7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1266 microversion: 2.1 time: 0.252045 Aug 12 06:56:06.253617 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 470/969] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:05 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:07.274762 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-396c19e3-7f3d-4919-9da7-540f9a83b2af tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:07.276622 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-396c19e3-7f3d-4919-9da7-540f9a83b2af tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:07.285642 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-396c19e3-7f3d-4919-9da7-540f9a83b2af tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:07.286875 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-396c19e3-7f3d-4919-9da7-540f9a83b2af tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:07.287768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-396c19e3-7f3d-4919-9da7-540f9a83b2af tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:07.289649 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-396c19e3-7f3d-4919-9da7-540f9a83b2af tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:07.290368 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-396c19e3-7f3d-4919-9da7-540f9a83b2af tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:07.290844 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-396c19e3-7f3d-4919-9da7-540f9a83b2af tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:07.501010 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-396c19e3-7f3d-4919-9da7-540f9a83b2af tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:07.529855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-396c19e3-7f3d-4919-9da7-540f9a83b2af tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1266 microversion: 2.1 time: 0.259579 Aug 12 06:56:07.531602 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 500/970] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:07 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:08.554045 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a9192822-6b2f-4c0e-a7cf-60dfbabd38ec tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:08.555274 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a9192822-6b2f-4c0e-a7cf-60dfbabd38ec tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:08.563596 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9192822-6b2f-4c0e-a7cf-60dfbabd38ec tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:08.564387 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9192822-6b2f-4c0e-a7cf-60dfbabd38ec tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:08.565127 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9192822-6b2f-4c0e-a7cf-60dfbabd38ec tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:08.566136 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9192822-6b2f-4c0e-a7cf-60dfbabd38ec tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:08.566871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9192822-6b2f-4c0e-a7cf-60dfbabd38ec tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:08.567693 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a9192822-6b2f-4c0e-a7cf-60dfbabd38ec tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:08.809022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a9192822-6b2f-4c0e-a7cf-60dfbabd38ec tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:08.819732 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a9192822-6b2f-4c0e-a7cf-60dfbabd38ec tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1266 microversion: 2.1 time: 0.271275 Aug 12 06:56:08.833476 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 471/971] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:08 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:09.842892 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4ce932c0-dfa7-40d0-988a-dc2b8e500a78 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:09.844877 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4ce932c0-dfa7-40d0-988a-dc2b8e500a78 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:09.853666 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ce932c0-dfa7-40d0-988a-dc2b8e500a78 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:09.854441 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ce932c0-dfa7-40d0-988a-dc2b8e500a78 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:09.855068 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ce932c0-dfa7-40d0-988a-dc2b8e500a78 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:09.856247 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ce932c0-dfa7-40d0-988a-dc2b8e500a78 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:09.856887 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ce932c0-dfa7-40d0-988a-dc2b8e500a78 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:09.857464 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ce932c0-dfa7-40d0-988a-dc2b8e500a78 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:10.060346 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4ce932c0-dfa7-40d0-988a-dc2b8e500a78 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:10.071188 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4ce932c0-dfa7-40d0-988a-dc2b8e500a78 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1266 microversion: 2.1 time: 0.233446 Aug 12 06:56:10.072807 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 501/972] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:09 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:11.096044 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cb956ff2-b812-4654-be1d-86366a458689 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:11.096726 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cb956ff2-b812-4654-be1d-86366a458689 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:11.106995 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb956ff2-b812-4654-be1d-86366a458689 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:11.107473 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb956ff2-b812-4654-be1d-86366a458689 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:11.107905 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb956ff2-b812-4654-be1d-86366a458689 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:11.108590 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb956ff2-b812-4654-be1d-86366a458689 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:11.109363 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb956ff2-b812-4654-be1d-86366a458689 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:11.109952 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb956ff2-b812-4654-be1d-86366a458689 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:11.285886 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cb956ff2-b812-4654-be1d-86366a458689 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:11.298333 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cb956ff2-b812-4654-be1d-86366a458689 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1266 microversion: 2.1 time: 0.206246 Aug 12 06:56:11.312096 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 472/973] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:11 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:12.321179 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-53303e3f-15fe-4ce5-ac32-b36101e8ad34 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:12.322588 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-53303e3f-15fe-4ce5-ac32-b36101e8ad34 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:12.330234 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:12.332456 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:12.335396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53303e3f-15fe-4ce5-ac32-b36101e8ad34 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:12.336342 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53303e3f-15fe-4ce5-ac32-b36101e8ad34 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:12.337168 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53303e3f-15fe-4ce5-ac32-b36101e8ad34 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:12.338654 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53303e3f-15fe-4ce5-ac32-b36101e8ad34 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:12.339179 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53303e3f-15fe-4ce5-ac32-b36101e8ad34 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:12.340655 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53303e3f-15fe-4ce5-ac32-b36101e8ad34 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:12.490813 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-53303e3f-15fe-4ce5-ac32-b36101e8ad34 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:12.499147 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-53303e3f-15fe-4ce5-ac32-b36101e8ad34 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1266 microversion: 2.1 time: 0.182177 Aug 12 06:56:12.500016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 502/974] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:12 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:13.522786 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-078ec23c-a111-46a2-8ed8-cebbbb840b96 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:13.524701 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-078ec23c-a111-46a2-8ed8-cebbbb840b96 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:13.545977 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:13.551791 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-078ec23c-a111-46a2-8ed8-cebbbb840b96 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:13.552907 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-078ec23c-a111-46a2-8ed8-cebbbb840b96 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:13.555764 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-078ec23c-a111-46a2-8ed8-cebbbb840b96 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:13.558589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-078ec23c-a111-46a2-8ed8-cebbbb840b96 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:13.559125 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-078ec23c-a111-46a2-8ed8-cebbbb840b96 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:13.560466 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-078ec23c-a111-46a2-8ed8-cebbbb840b96 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:14.129541 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-078ec23c-a111-46a2-8ed8-cebbbb840b96 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:14.146568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-078ec23c-a111-46a2-8ed8-cebbbb840b96 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1266 microversion: 2.1 time: 0.630064 Aug 12 06:56:14.148442 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 473/975] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:13 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1266 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:15.171559 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b07b9517-1ab6-41ae-a8ee-8e4bf6c8f41b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:15.172160 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b07b9517-1ab6-41ae-a8ee-8e4bf6c8f41b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:15.186475 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b07b9517-1ab6-41ae-a8ee-8e4bf6c8f41b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:15.187351 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b07b9517-1ab6-41ae-a8ee-8e4bf6c8f41b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:15.191324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b07b9517-1ab6-41ae-a8ee-8e4bf6c8f41b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:15.192381 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b07b9517-1ab6-41ae-a8ee-8e4bf6c8f41b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:15.193182 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b07b9517-1ab6-41ae-a8ee-8e4bf6c8f41b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:15.193825 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b07b9517-1ab6-41ae-a8ee-8e4bf6c8f41b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:15.720811 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b07b9517-1ab6-41ae-a8ee-8e4bf6c8f41b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:15.729994 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b07b9517-1ab6-41ae-a8ee-8e4bf6c8f41b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1266 microversion: 2.1 time: 0.562255 Aug 12 06:56:15.730595 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 503/976] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:15 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1266 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:16.751901 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c243754b-27b9-4209-8e5c-2b282277d3a7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:16.754269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c243754b-27b9-4209-8e5c-2b282277d3a7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:16.762597 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c243754b-27b9-4209-8e5c-2b282277d3a7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:16.765247 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c243754b-27b9-4209-8e5c-2b282277d3a7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:16.765889 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c243754b-27b9-4209-8e5c-2b282277d3a7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:16.767415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c243754b-27b9-4209-8e5c-2b282277d3a7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:16.768110 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c243754b-27b9-4209-8e5c-2b282277d3a7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:16.768889 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c243754b-27b9-4209-8e5c-2b282277d3a7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:17.054645 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c243754b-27b9-4209-8e5c-2b282277d3a7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:17.076397 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c243754b-27b9-4209-8e5c-2b282277d3a7 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1266 microversion: 2.1 time: 0.329118 Aug 12 06:56:17.079627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 474/977] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:16 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:17.136277 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-a2f6dcde-fdd8-4b1a-9585-b9d3f95ec62c req-a0adf684-27b3-4781-bc14-10006f42d396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a9065d-a53f-4325-b7eb-a0aad221c075", "name": "network-vif-plugged", "status": "completed", "tag": "f93c3d68-b767-428a-9306-42ffdec5cf15"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:17.158394 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a2f6dcde-fdd8-4b1a-9585-b9d3f95ec62c req-a0adf684-27b3-4781-bc14-10006f42d396 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:17.160318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a2f6dcde-fdd8-4b1a-9585-b9d3f95ec62c req-a0adf684-27b3-4781-bc14-10006f42d396 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:17.160781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a2f6dcde-fdd8-4b1a-9585-b9d3f95ec62c req-a0adf684-27b3-4781-bc14-10006f42d396 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:17.179736 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-a2f6dcde-fdd8-4b1a-9585-b9d3f95ec62c req-a0adf684-27b3-4781-bc14-10006f42d396 service nova] Creating event network-vif-plugged:f93c3d68-b767-428a-9306-42ffdec5cf15 for instance 86a9065d-a53f-4325-b7eb-a0aad221c075 on hv-cinder-84457 Aug 12 06:56:17.187462 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-a2f6dcde-fdd8-4b1a-9585-b9d3f95ec62c req-a0adf684-27b3-4781-bc14-10006f42d396 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053668 Aug 12 06:56:17.189942 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 504/978] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:56:17.817046 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-777c76fc-a85a-443e-8b8f-6c343040d37f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Action: 'create', calling method: .version_select at 0x7fc7048933a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-348499657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/822C7OLvKnwbEwdsbDANRWlqOCLEtxklYcveWb28zwLymquJl6nvCwiXmn2/MBLPR3U9FGD5fXaRrywdxdeLjXd6vnHry1ZSI5X4Mjr9n07AnWHpWSvbQlXKmcVzvZw=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:17.836011 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-777c76fc-a85a-443e-8b8f-6c343040d37f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Getting quotas for project 8139d6fef5384619a46f4b7f2095a565. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:56:17.842411 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-777c76fc-a85a-443e-8b8f-6c343040d37f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Getting quotas for user 7450a2c6c0364245a9e609577e82859d and project 8139d6fef5384619a46f4b7f2095a565. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:56:17.875503 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-777c76fc-a85a-443e-8b8f-6c343040d37f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.467286 Aug 12 06:56:17.881789 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 475/979] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 06:56:17 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:56:18.101459 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1b3f4eda-5769-4136-8164-8c4a4af0db9e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:18.102819 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1b3f4eda-5769-4136-8164-8c4a4af0db9e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:18.111248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b3f4eda-5769-4136-8164-8c4a4af0db9e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:18.112583 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b3f4eda-5769-4136-8164-8c4a4af0db9e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:18.113675 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b3f4eda-5769-4136-8164-8c4a4af0db9e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:18.117854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b3f4eda-5769-4136-8164-8c4a4af0db9e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:18.119967 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b3f4eda-5769-4136-8164-8c4a4af0db9e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:18.120689 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b3f4eda-5769-4136-8164-8c4a4af0db9e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:18.370323 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1b3f4eda-5769-4136-8164-8c4a4af0db9e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:18.381336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1b3f4eda-5769-4136-8164-8c4a4af0db9e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1266 microversion: 2.1 time: 0.285416 Aug 12 06:56:18.396202 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 505/980] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:18 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:19.406049 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6bf2883e-80fb-419d-a382-a8a23ef47afe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:19.406655 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6bf2883e-80fb-419d-a382-a8a23ef47afe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:19.424045 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bf2883e-80fb-419d-a382-a8a23ef47afe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:19.425962 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bf2883e-80fb-419d-a382-a8a23ef47afe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:19.427061 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bf2883e-80fb-419d-a382-a8a23ef47afe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:19.428280 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bf2883e-80fb-419d-a382-a8a23ef47afe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:19.429774 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bf2883e-80fb-419d-a382-a8a23ef47afe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:19.430741 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6bf2883e-80fb-419d-a382-a8a23ef47afe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:19.608781 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6bf2883e-80fb-419d-a382-a8a23ef47afe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:19.619267 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6bf2883e-80fb-419d-a382-a8a23ef47afe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1452 microversion: 2.1 time: 0.217473 Aug 12 06:56:19.621021 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 476/981] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:19 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1452 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:19.640452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4a1442c-59a2-428f-adef-2140b88cfbc4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:19.641083 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4a1442c-59a2-428f-adef-2140b88cfbc4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:19.648305 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4a1442c-59a2-428f-adef-2140b88cfbc4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:19.648803 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4a1442c-59a2-428f-adef-2140b88cfbc4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:19.649334 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4a1442c-59a2-428f-adef-2140b88cfbc4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:19.650164 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4a1442c-59a2-428f-adef-2140b88cfbc4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:19.650782 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4a1442c-59a2-428f-adef-2140b88cfbc4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:19.651444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4a1442c-59a2-428f-adef-2140b88cfbc4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:19.823518 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f4a1442c-59a2-428f-adef-2140b88cfbc4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:19.835205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f4a1442c-59a2-428f-adef-2140b88cfbc4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1452 microversion: 2.1 time: 0.198324 Aug 12 06:56:19.839277 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 506/982] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:19 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:22.113405 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-700af5d8-e113-4f78-9e42-292a6fe2105b req-a1b11d95-7ed8-41bc-84fa-991248f3f524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a9065d-a53f-4325-b7eb-a0aad221c075", "tag": "f93c3d68-b767-428a-9306-42ffdec5cf15"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:22.124229 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-700af5d8-e113-4f78-9e42-292a6fe2105b req-a1b11d95-7ed8-41bc-84fa-991248f3f524 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:22.124838 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-700af5d8-e113-4f78-9e42-292a6fe2105b req-a1b11d95-7ed8-41bc-84fa-991248f3f524 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:22.125423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-700af5d8-e113-4f78-9e42-292a6fe2105b req-a1b11d95-7ed8-41bc-84fa-991248f3f524 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:22.137128 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-700af5d8-e113-4f78-9e42-292a6fe2105b req-a1b11d95-7ed8-41bc-84fa-991248f3f524 service nova] Creating event network-changed:f93c3d68-b767-428a-9306-42ffdec5cf15 for instance 86a9065d-a53f-4325-b7eb-a0aad221c075 on hv-cinder-84457 Aug 12 06:56:22.142912 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-700af5d8-e113-4f78-9e42-292a6fe2105b req-a1b11d95-7ed8-41bc-84fa-991248f3f524 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033984 Aug 12 06:56:22.143955 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 477/983] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:56:22.487170 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-328687822", "imageRef": "f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2", "flavorRef": "452"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:22.546713 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] validate_networks() for None {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:56:22.982714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:56:22.983173 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:56:22.983687 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:56:22.984288 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:56:22.984702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:56:22.994103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:22.994600 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:22.995040 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:22.996336 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:22.996825 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:22.997250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:23.021114 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Getting quotas for project f54ac28f4e92423990bd9f55f518b211. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:56:23.025434 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Getting quotas for user f41179a0112a4db89a3eb3ef802e7fd6 and project f54ac28f4e92423990bd9f55f518b211. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:56:23.039153 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:56:23.041537 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1e7d9d2-c55b-41e2-b555-9d54dc35f2a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:56:23.097730 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-adeccc19-db56-4018-b98a-052417e1954f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614714 Aug 12 06:56:23.098391 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 507/984] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:56:23.112742 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-51bb73a0-5887-4337-9a0a-89662df8f0a8 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:23.113485 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-51bb73a0-5887-4337-9a0a-89662df8f0a8 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:23.190495 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-51bb73a0-5887-4337-9a0a-89662df8f0a8 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:23.198626 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-51bb73a0-5887-4337-9a0a-89662df8f0a8 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1214 microversion: 2.1 time: 0.092550 Aug 12 06:56:23.202957 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 478/985] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:23 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:24.230899 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5a7f3ea1-f26f-4cc8-84fc-2e54963b716c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:24.239335 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5a7f3ea1-f26f-4cc8-84fc-2e54963b716c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:24.246888 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a7f3ea1-f26f-4cc8-84fc-2e54963b716c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:24.247670 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a7f3ea1-f26f-4cc8-84fc-2e54963b716c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:24.248334 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a7f3ea1-f26f-4cc8-84fc-2e54963b716c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:24.249773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a7f3ea1-f26f-4cc8-84fc-2e54963b716c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:24.251353 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a7f3ea1-f26f-4cc8-84fc-2e54963b716c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:24.251804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a7f3ea1-f26f-4cc8-84fc-2e54963b716c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:24.407439 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5a7f3ea1-f26f-4cc8-84fc-2e54963b716c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:24.416383 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5a7f3ea1-f26f-4cc8-84fc-2e54963b716c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1274 microversion: 2.1 time: 0.196163 Aug 12 06:56:24.417127 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 508/986] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:24 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:56:25.437787 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c78fd9a2-a88f-4cbc-9e39-506bf281b86c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:25.438484 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c78fd9a2-a88f-4cbc-9e39-506bf281b86c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:25.446150 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c78fd9a2-a88f-4cbc-9e39-506bf281b86c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:25.446651 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c78fd9a2-a88f-4cbc-9e39-506bf281b86c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:25.447112 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c78fd9a2-a88f-4cbc-9e39-506bf281b86c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:25.447804 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c78fd9a2-a88f-4cbc-9e39-506bf281b86c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:25.448250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c78fd9a2-a88f-4cbc-9e39-506bf281b86c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:25.448662 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c78fd9a2-a88f-4cbc-9e39-506bf281b86c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:25.677228 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c78fd9a2-a88f-4cbc-9e39-506bf281b86c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:25.685704 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c78fd9a2-a88f-4cbc-9e39-506bf281b86c tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1314 microversion: 2.1 time: 0.251817 Aug 12 06:56:25.686927 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 479/987] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:25 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:56:25.817254 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-abeb813f-6ad1-420e-be75-a01e8a306617 req-eafa79c7-1ccf-4442-ab67-a01baf01b66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33700c1d-0cac-4b77-bc91-c8a885da150b", "tag": "4d9f3f47-120b-4828-8c46-94e620ff12e9"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:25.832800 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-abeb813f-6ad1-420e-be75-a01e8a306617 req-eafa79c7-1ccf-4442-ab67-a01baf01b66d service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:25.833678 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-abeb813f-6ad1-420e-be75-a01e8a306617 req-eafa79c7-1ccf-4442-ab67-a01baf01b66d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:25.834202 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-abeb813f-6ad1-420e-be75-a01e8a306617 req-eafa79c7-1ccf-4442-ab67-a01baf01b66d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:25.853009 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-abeb813f-6ad1-420e-be75-a01e8a306617 req-eafa79c7-1ccf-4442-ab67-a01baf01b66d service nova] Creating event network-changed:4d9f3f47-120b-4828-8c46-94e620ff12e9 for instance 33700c1d-0cac-4b77-bc91-c8a885da150b on hv-cinder-84457 Aug 12 06:56:25.858315 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-abeb813f-6ad1-420e-be75-a01e8a306617 req-eafa79c7-1ccf-4442-ab67-a01baf01b66d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046206 Aug 12 06:56:25.859648 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 509/988] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:56:26.708890 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6d045ca0-99f1-4325-90f4-021f27fb8b72 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:26.709458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6d045ca0-99f1-4325-90f4-021f27fb8b72 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:26.716336 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d045ca0-99f1-4325-90f4-021f27fb8b72 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:26.716825 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d045ca0-99f1-4325-90f4-021f27fb8b72 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:26.717266 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d045ca0-99f1-4325-90f4-021f27fb8b72 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:26.717948 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d045ca0-99f1-4325-90f4-021f27fb8b72 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:26.718396 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d045ca0-99f1-4325-90f4-021f27fb8b72 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:26.718817 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d045ca0-99f1-4325-90f4-021f27fb8b72 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:26.866018 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6d045ca0-99f1-4325-90f4-021f27fb8b72 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:26.874802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6d045ca0-99f1-4325-90f4-021f27fb8b72 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1314 microversion: 2.1 time: 0.170138 Aug 12 06:56:26.875511 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 480/989] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:26 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:27.900304 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-81133f76-82a5-46ca-b615-597630257048 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:27.901056 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-81133f76-82a5-46ca-b615-597630257048 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:27.910027 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81133f76-82a5-46ca-b615-597630257048 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:27.910503 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81133f76-82a5-46ca-b615-597630257048 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:27.910926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81133f76-82a5-46ca-b615-597630257048 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:27.911673 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81133f76-82a5-46ca-b615-597630257048 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:27.912120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81133f76-82a5-46ca-b615-597630257048 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:27.912530 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81133f76-82a5-46ca-b615-597630257048 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:28.051720 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-81133f76-82a5-46ca-b615-597630257048 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:28.059717 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-81133f76-82a5-46ca-b615-597630257048 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1314 microversion: 2.1 time: 0.166449 Aug 12 06:56:28.060313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 510/990] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:27 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:29.082625 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0e9c78ad-525b-4653-944e-87b15800587a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:29.083315 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0e9c78ad-525b-4653-944e-87b15800587a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:29.090424 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e9c78ad-525b-4653-944e-87b15800587a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:29.090912 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e9c78ad-525b-4653-944e-87b15800587a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:29.091378 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e9c78ad-525b-4653-944e-87b15800587a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:29.092058 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e9c78ad-525b-4653-944e-87b15800587a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:29.092562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e9c78ad-525b-4653-944e-87b15800587a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:29.092959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e9c78ad-525b-4653-944e-87b15800587a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:29.235694 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0e9c78ad-525b-4653-944e-87b15800587a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:29.244024 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0e9c78ad-525b-4653-944e-87b15800587a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1314 microversion: 2.1 time: 0.166074 Aug 12 06:56:29.244939 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 481/991] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:29 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:30.266062 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3b0ce884-4bf3-440e-a416-c855c81f1556 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:30.267069 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3b0ce884-4bf3-440e-a416-c855c81f1556 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:30.273911 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b0ce884-4bf3-440e-a416-c855c81f1556 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:30.274396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b0ce884-4bf3-440e-a416-c855c81f1556 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:30.274828 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b0ce884-4bf3-440e-a416-c855c81f1556 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:30.275547 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b0ce884-4bf3-440e-a416-c855c81f1556 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:30.275992 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b0ce884-4bf3-440e-a416-c855c81f1556 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:30.276426 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b0ce884-4bf3-440e-a416-c855c81f1556 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:30.510532 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3b0ce884-4bf3-440e-a416-c855c81f1556 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:30.521055 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3b0ce884-4bf3-440e-a416-c855c81f1556 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1314 microversion: 2.1 time: 0.258783 Aug 12 06:56:30.521821 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 511/992] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:30 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:31.542052 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ed6a785b-c019-4961-8300-405a224001a1 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:31.542760 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ed6a785b-c019-4961-8300-405a224001a1 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:31.549776 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed6a785b-c019-4961-8300-405a224001a1 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:31.550266 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed6a785b-c019-4961-8300-405a224001a1 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:31.550703 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed6a785b-c019-4961-8300-405a224001a1 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:31.551413 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed6a785b-c019-4961-8300-405a224001a1 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:31.551899 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed6a785b-c019-4961-8300-405a224001a1 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:31.552329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed6a785b-c019-4961-8300-405a224001a1 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:31.689860 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ed6a785b-c019-4961-8300-405a224001a1 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:31.698076 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ed6a785b-c019-4961-8300-405a224001a1 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1314 microversion: 2.1 time: 0.160006 Aug 12 06:56:31.698628 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 482/993] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:31 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:32.720804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2d2c5cf6-0c13-4575-8f17-9e7de8ccaf92 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:32.721426 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2d2c5cf6-0c13-4575-8f17-9e7de8ccaf92 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:32.724039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:32.729451 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2c5cf6-0c13-4575-8f17-9e7de8ccaf92 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:32.729962 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2c5cf6-0c13-4575-8f17-9e7de8ccaf92 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:32.730432 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2c5cf6-0c13-4575-8f17-9e7de8ccaf92 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:32.731280 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2c5cf6-0c13-4575-8f17-9e7de8ccaf92 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:32.731816 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2c5cf6-0c13-4575-8f17-9e7de8ccaf92 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:32.732321 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2c5cf6-0c13-4575-8f17-9e7de8ccaf92 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:32.737154 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=71 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:32.865854 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2d2c5cf6-0c13-4575-8f17-9e7de8ccaf92 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:32.873724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2d2c5cf6-0c13-4575-8f17-9e7de8ccaf92 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1314 microversion: 2.1 time: 0.157178 Aug 12 06:56:32.874282 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 512/994] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:32 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:33.100901 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-d6ce63f0-c294-437e-9374-69d292191f60 req-a9493ae2-c1f4-4705-8f02-8d3f73b3e5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33700c1d-0cac-4b77-bc91-c8a885da150b", "name": "network-vif-plugged", "status": "completed", "tag": "4d9f3f47-120b-4828-8c46-94e620ff12e9"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:33.106494 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:33.112765 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-d6ce63f0-c294-437e-9374-69d292191f60 req-a9493ae2-c1f4-4705-8f02-8d3f73b3e5f9 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:33.113337 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-d6ce63f0-c294-437e-9374-69d292191f60 req-a9493ae2-c1f4-4705-8f02-8d3f73b3e5f9 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:33.113871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-d6ce63f0-c294-437e-9374-69d292191f60 req-a9493ae2-c1f4-4705-8f02-8d3f73b3e5f9 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:33.118224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=69 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:33.126483 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-d6ce63f0-c294-437e-9374-69d292191f60 req-a9493ae2-c1f4-4705-8f02-8d3f73b3e5f9 service nova] Creating event network-vif-plugged:4d9f3f47-120b-4828-8c46-94e620ff12e9 for instance 33700c1d-0cac-4b77-bc91-c8a885da150b on hv-cinder-84457 Aug 12 06:56:33.131792 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-d6ce63f0-c294-437e-9374-69d292191f60 req-a9493ae2-c1f4-4705-8f02-8d3f73b3e5f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034650 Aug 12 06:56:33.132364 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 483/995] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:56:33.895286 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-91c13b46-a8e4-4bf7-ba95-93af82346a9f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:33.895886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-91c13b46-a8e4-4bf7-ba95-93af82346a9f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:33.897743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:33.898403 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:33.904786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91c13b46-a8e4-4bf7-ba95-93af82346a9f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:33.905269 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91c13b46-a8e4-4bf7-ba95-93af82346a9f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:33.905685 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91c13b46-a8e4-4bf7-ba95-93af82346a9f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:33.906370 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91c13b46-a8e4-4bf7-ba95-93af82346a9f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:33.906815 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91c13b46-a8e4-4bf7-ba95-93af82346a9f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:33.907261 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91c13b46-a8e4-4bf7-ba95-93af82346a9f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:34.047312 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-91c13b46-a8e4-4bf7-ba95-93af82346a9f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:34.055194 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-91c13b46-a8e4-4bf7-ba95-93af82346a9f tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1314 microversion: 2.1 time: 0.165295 Aug 12 06:56:34.055795 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 513/996] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:33 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:35.073161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:35.078025 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-76cdce11-559a-40e8-a393-6d8866f8dc34 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:35.078757 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-76cdce11-559a-40e8-a393-6d8866f8dc34 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:35.085198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76cdce11-559a-40e8-a393-6d8866f8dc34 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:35.085674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76cdce11-559a-40e8-a393-6d8866f8dc34 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:35.086101 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76cdce11-559a-40e8-a393-6d8866f8dc34 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:35.086795 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76cdce11-559a-40e8-a393-6d8866f8dc34 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:35.087271 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76cdce11-559a-40e8-a393-6d8866f8dc34 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:35.087690 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76cdce11-559a-40e8-a393-6d8866f8dc34 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:35.233463 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-76cdce11-559a-40e8-a393-6d8866f8dc34 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:35.241837 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-76cdce11-559a-40e8-a393-6d8866f8dc34 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1464 microversion: 2.1 time: 0.169511 Aug 12 06:56:35.242410 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 484/997] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:35 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:35.296780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6d3830de-227b-4505-8326-508a19fb8737 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:35.297306 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6d3830de-227b-4505-8326-508a19fb8737 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:35.304035 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d3830de-227b-4505-8326-508a19fb8737 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:35.304511 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d3830de-227b-4505-8326-508a19fb8737 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:35.304931 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d3830de-227b-4505-8326-508a19fb8737 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:35.305611 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d3830de-227b-4505-8326-508a19fb8737 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:35.306051 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d3830de-227b-4505-8326-508a19fb8737 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:35.306462 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d3830de-227b-4505-8326-508a19fb8737 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:35.334371 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6d3830de-227b-4505-8326-508a19fb8737 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:56:35.420555 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6d3830de-227b-4505-8326-508a19fb8737 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "DELETE /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 204 len: 0 microversion: 2.1 time: 0.127239 Aug 12 06:56:35.421004 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 514/998] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:56:35 2022] DELETE /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:56:35.430224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2375a22c-5785-4871-b48a-46a735fd9169 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:35.430928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2375a22c-5785-4871-b48a-46a735fd9169 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:35.437114 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375a22c-5785-4871-b48a-46a735fd9169 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:35.437589 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375a22c-5785-4871-b48a-46a735fd9169 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:35.438008 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375a22c-5785-4871-b48a-46a735fd9169 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:35.438725 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375a22c-5785-4871-b48a-46a735fd9169 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:35.439203 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375a22c-5785-4871-b48a-46a735fd9169 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:35.439679 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375a22c-5785-4871-b48a-46a735fd9169 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:35.583229 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2375a22c-5785-4871-b48a-46a735fd9169 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:35.591127 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2375a22c-5785-4871-b48a-46a735fd9169 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1470 microversion: 2.1 time: 0.164868 Aug 12 06:56:35.591691 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 485/999] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:35 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:56:36.613050 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8b92cdba-1501-4622-a1f0-bb8be80f945a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:36.613733 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8b92cdba-1501-4622-a1f0-bb8be80f945a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:36.621287 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b92cdba-1501-4622-a1f0-bb8be80f945a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:36.621949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b92cdba-1501-4622-a1f0-bb8be80f945a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:36.622501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b92cdba-1501-4622-a1f0-bb8be80f945a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:36.623347 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b92cdba-1501-4622-a1f0-bb8be80f945a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:36.623851 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b92cdba-1501-4622-a1f0-bb8be80f945a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:36.624353 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b92cdba-1501-4622-a1f0-bb8be80f945a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:36.761287 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8b92cdba-1501-4622-a1f0-bb8be80f945a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:36.769514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8b92cdba-1501-4622-a1f0-bb8be80f945a tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1470 microversion: 2.1 time: 0.160833 Aug 12 06:56:36.770023 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 515/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:36 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:37.075681 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-113834353", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-348499657", "security_groups": [{"name": "tempest-secgroup-smoke-1863305486"}], "networks": [{"uuid": "cda05dcb-d9fa-4d78-a2b5-0fee9fa8d641"}], "block_device_mapping_v2": [{"uuid": "d16e11bc-48b6-4143-9a6e-3c00e9a8eeed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:37.221234 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] validate_networks() for [('cda05dcb-d9fa-4d78-a2b5-0fee9fa8d641', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:56:37.790092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fe3e9098-526a-4e84-87a6-2bd8d8af452d tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:37.790698 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fe3e9098-526a-4e84-87a6-2bd8d8af452d tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:37.797445 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3e9098-526a-4e84-87a6-2bd8d8af452d tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:37.797924 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3e9098-526a-4e84-87a6-2bd8d8af452d tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:37.798319 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3e9098-526a-4e84-87a6-2bd8d8af452d tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:37.799073 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3e9098-526a-4e84-87a6-2bd8d8af452d tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:37.799509 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3e9098-526a-4e84-87a6-2bd8d8af452d tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:37.799921 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3e9098-526a-4e84-87a6-2bd8d8af452d tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:37.834128 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:56:37.834566 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:56:37.835195 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:56:37.835628 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:56:37.836050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:56:37.845415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:37.846033 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:37.846489 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:37.847241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:37.847691 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:37.848113 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:37.865557 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Getting quotas for project 8139d6fef5384619a46f4b7f2095a565. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:56:37.869521 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Getting quotas for user 7450a2c6c0364245a9e609577e82859d and project 8139d6fef5384619a46f4b7f2095a565. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:56:37.895998 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fe3e9098-526a-4e84-87a6-2bd8d8af452d tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f41179a0112a4db89a3eb3ef802e7fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54ac28f4e92423990bd9f55f518b211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:37.911470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fe3e9098-526a-4e84-87a6-2bd8d8af452d tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 200 len: 1428 microversion: 2.1 time: 0.125093 Aug 12 06:56:37.925408 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 516/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:37 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 1428 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:37.971833 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-10f6dae0-4365-4264-b8f5-5506fa3de4c8 req-4eb3764d-0d35-42fc-bcf3-2c85bfc4211d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33700c1d-0cac-4b77-bc91-c8a885da150b", "name": "network-vif-deleted", "tag": "4d9f3f47-120b-4828-8c46-94e620ff12e9"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:37.977286 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:56:37.979862 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d16e11bc-48b6-4143-9a6e-3c00e9a8eeed',volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:56:37.983978 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-10f6dae0-4365-4264-b8f5-5506fa3de4c8 req-4eb3764d-0d35-42fc-bcf3-2c85bfc4211d service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:37.984450 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-10f6dae0-4365-4264-b8f5-5506fa3de4c8 req-4eb3764d-0d35-42fc-bcf3-2c85bfc4211d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:37.984867 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-10f6dae0-4365-4264-b8f5-5506fa3de4c8 req-4eb3764d-0d35-42fc-bcf3-2c85bfc4211d service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:38.004262 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-10f6dae0-4365-4264-b8f5-5506fa3de4c8 req-4eb3764d-0d35-42fc-bcf3-2c85bfc4211d service nova] Creating event network-vif-deleted:4d9f3f47-120b-4828-8c46-94e620ff12e9 for instance 33700c1d-0cac-4b77-bc91-c8a885da150b on hv-cinder-84457 Aug 12 06:56:38.009463 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-10f6dae0-4365-4264-b8f5-5506fa3de4c8 req-4eb3764d-0d35-42fc-bcf3-2c85bfc4211d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041634 Aug 12 06:56:38.010143 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 517/1002] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:56:38.136488 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3c3895b2-3959-45d1-8fb8-61523969014f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.064606 Aug 12 06:56:38.137475 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 486/1003] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:56:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:56:38.149371 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b8246d96-7331-4cc3-9a52-7434c7c7c874 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:38.150213 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b8246d96-7331-4cc3-9a52-7434c7c7c874 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:38.211995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8246d96-7331-4cc3-9a52-7434c7c7c874 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:38.221657 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b8246d96-7331-4cc3-9a52-7434c7c7c874 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1087 microversion: 2.1 time: 0.076688 Aug 12 06:56:38.222335 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 518/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:38 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:56:38.932750 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:38.933836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] [instance: 33700c1d-0cac-4b77-bc91-c8a885da150b] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:38.941080 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:38.941643 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:38.942191 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:38.943108 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:38.943693 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:38.944283 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:38.973600 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] HTTP exception thrown: Instance 33700c1d-0cac-4b77-bc91-c8a885da150b could not be found. Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Request method failure captured: Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b HTTP/1.1 Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fmU8Kdk22e4nzN-JE5aucdqXExS6EwseReGhd58_B9IHk51QeCYpDtFfLlBD0F4UUTVUihmFOOYHpplA7sBjM1YZB84x6U-BoLQ6Us507VPR858nKjNQAzOhZnpm6pfcfzLw_1_v_xNniyGMu9GGausOi9Yt2SJTClL4AxKk9ovpBY Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: f54ac28f4e92423990bd9f55f518b211 Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesNegativeTest-933233094 Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:56:38.977458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f54ac28f4e92423990bd9f55f518b211", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f54ac28f4e92423990bd9f55f518b211"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f54ac28f4e92423990bd9f55f518b211"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f54ac28f4e92423990bd9f55f518b211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesNegativeTest-933233094 Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: f54ac28f4e92423990bd9f55f518b211 Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesNegativeTest-933233094 Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesNegativeTest-933233094-project Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: f41179a0112a4db89a3eb3ef802e7fd6 Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesNegativeTest-933233094-project Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 33700c1d-0cac-4b77-bc91-c8a885da150b could not be found. Aug 12 06:56:38.979241 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '33700c1d-0cac-4b77-bc91-c8a885da150b'} Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33700c1d-0cac-4b77-bc91-c8a885da150b could not be found. Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:56:38.980177 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33700c1d-0cac-4b77-bc91-c8a885da150b could not be found. Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33700c1d-0cac-4b77-bc91-c8a885da150b could not be found. Aug 12 06:56:38.981700 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:56:38.983118 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] Returning 404 to user: Instance 33700c1d-0cac-4b77-bc91-c8a885da150b could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:56:38.983118 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f354a09c-8e25-4ec8-abb9-41d120c4c286 tempest-VolumesNegativeTest-933233094 tempest-VolumesNegativeTest-933233094-project] 10.222.0.20 "GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b" status: 404 len: 111 microversion: 2.1 time: 0.050230 Aug 12 06:56:38.983118 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 487/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:38 2022] GET /compute/v2.1/servers/33700c1d-0cac-4b77-bc91-c8a885da150b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:56:39.241803 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c07785bc-22e0-4300-a427-d877dec463c1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:39.242432 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c07785bc-22e0-4300-a427-d877dec463c1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:39.249984 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c07785bc-22e0-4300-a427-d877dec463c1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:39.250468 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c07785bc-22e0-4300-a427-d877dec463c1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:39.250919 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c07785bc-22e0-4300-a427-d877dec463c1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:39.251720 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c07785bc-22e0-4300-a427-d877dec463c1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:39.252171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c07785bc-22e0-4300-a427-d877dec463c1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:39.252581 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c07785bc-22e0-4300-a427-d877dec463c1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:39.318337 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c07785bc-22e0-4300-a427-d877dec463c1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:39.327167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c07785bc-22e0-4300-a427-d877dec463c1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1185 microversion: 2.1 time: 0.089128 Aug 12 06:56:39.338480 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 519/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:39 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:40.353515 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bda4bbc5-f9c1-4251-96f7-d700f106f07f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:40.354141 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bda4bbc5-f9c1-4251-96f7-d700f106f07f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:40.362847 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bda4bbc5-f9c1-4251-96f7-d700f106f07f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:40.363625 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bda4bbc5-f9c1-4251-96f7-d700f106f07f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:40.364061 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bda4bbc5-f9c1-4251-96f7-d700f106f07f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:40.365318 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bda4bbc5-f9c1-4251-96f7-d700f106f07f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:40.366824 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bda4bbc5-f9c1-4251-96f7-d700f106f07f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:40.367785 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bda4bbc5-f9c1-4251-96f7-d700f106f07f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:40.635569 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bda4bbc5-f9c1-4251-96f7-d700f106f07f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:40.644455 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bda4bbc5-f9c1-4251-96f7-d700f106f07f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1271 microversion: 2.1 time: 0.296972 Aug 12 06:56:40.645076 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 488/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:40 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1271 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:41.094008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-8c565b2b-20f2-48ba-81d6-85a703124163 req-09679f18-8d12-4c83-a03e-5c65abd98099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397bc232-8dd0-4925-89b3-7f2cd5a06dd5", "tag": "7022fc1a-cc3e-4c75-84ac-18933a74f704"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:41.104175 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8c565b2b-20f2-48ba-81d6-85a703124163 req-09679f18-8d12-4c83-a03e-5c65abd98099 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:41.104833 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8c565b2b-20f2-48ba-81d6-85a703124163 req-09679f18-8d12-4c83-a03e-5c65abd98099 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:41.106154 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8c565b2b-20f2-48ba-81d6-85a703124163 req-09679f18-8d12-4c83-a03e-5c65abd98099 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:41.122185 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-8c565b2b-20f2-48ba-81d6-85a703124163 req-09679f18-8d12-4c83-a03e-5c65abd98099 service nova] Creating event network-changed:7022fc1a-cc3e-4c75-84ac-18933a74f704 for instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 on hv-cinder-84457 Aug 12 06:56:41.140324 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-8c565b2b-20f2-48ba-81d6-85a703124163 req-09679f18-8d12-4c83-a03e-5c65abd98099 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049956 Aug 12 06:56:41.141761 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 520/1008] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:56:41.666618 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d79aafd6-5cda-4531-bcde-e15ae089115e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:41.667440 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d79aafd6-5cda-4531-bcde-e15ae089115e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:41.674046 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79aafd6-5cda-4531-bcde-e15ae089115e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:41.674526 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79aafd6-5cda-4531-bcde-e15ae089115e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:41.674938 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79aafd6-5cda-4531-bcde-e15ae089115e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:41.675868 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79aafd6-5cda-4531-bcde-e15ae089115e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:41.676493 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79aafd6-5cda-4531-bcde-e15ae089115e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:41.676719 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79aafd6-5cda-4531-bcde-e15ae089115e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:41.816573 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d79aafd6-5cda-4531-bcde-e15ae089115e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:41.826045 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d79aafd6-5cda-4531-bcde-e15ae089115e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1259 microversion: 2.1 time: 0.164074 Aug 12 06:56:41.826612 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 489/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:41 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:42.850521 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fea85ffb-75db-4fc6-94f1-88e35dd7563c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:42.851248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fea85ffb-75db-4fc6-94f1-88e35dd7563c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:42.858006 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fea85ffb-75db-4fc6-94f1-88e35dd7563c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:42.858504 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fea85ffb-75db-4fc6-94f1-88e35dd7563c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:42.858961 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fea85ffb-75db-4fc6-94f1-88e35dd7563c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:42.859657 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fea85ffb-75db-4fc6-94f1-88e35dd7563c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:42.860108 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fea85ffb-75db-4fc6-94f1-88e35dd7563c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:42.860528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fea85ffb-75db-4fc6-94f1-88e35dd7563c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:42.994604 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fea85ffb-75db-4fc6-94f1-88e35dd7563c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:43.002701 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fea85ffb-75db-4fc6-94f1-88e35dd7563c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1259 microversion: 2.1 time: 0.157325 Aug 12 06:56:43.003299 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 521/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:42 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:44.025382 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1706020d-36b8-46a2-acd8-e5e58ea74a20 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:44.026017 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1706020d-36b8-46a2-acd8-e5e58ea74a20 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:44.033073 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1706020d-36b8-46a2-acd8-e5e58ea74a20 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:44.033568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1706020d-36b8-46a2-acd8-e5e58ea74a20 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:44.034067 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1706020d-36b8-46a2-acd8-e5e58ea74a20 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:44.034844 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1706020d-36b8-46a2-acd8-e5e58ea74a20 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:44.035415 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1706020d-36b8-46a2-acd8-e5e58ea74a20 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:44.036003 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1706020d-36b8-46a2-acd8-e5e58ea74a20 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:44.181682 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1706020d-36b8-46a2-acd8-e5e58ea74a20 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:44.192982 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1706020d-36b8-46a2-acd8-e5e58ea74a20 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1259 microversion: 2.1 time: 0.171401 Aug 12 06:56:44.193859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 490/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:44 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:45.216580 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5522dfec-8b63-420e-896e-b95ac2b67c8c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:45.217148 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5522dfec-8b63-420e-896e-b95ac2b67c8c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:45.224476 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5522dfec-8b63-420e-896e-b95ac2b67c8c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:45.224960 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5522dfec-8b63-420e-896e-b95ac2b67c8c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:45.225365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5522dfec-8b63-420e-896e-b95ac2b67c8c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:45.226106 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5522dfec-8b63-420e-896e-b95ac2b67c8c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:45.226559 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5522dfec-8b63-420e-896e-b95ac2b67c8c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:45.227004 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5522dfec-8b63-420e-896e-b95ac2b67c8c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:45.364943 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5522dfec-8b63-420e-896e-b95ac2b67c8c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:45.372965 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5522dfec-8b63-420e-896e-b95ac2b67c8c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1259 microversion: 2.1 time: 0.160586 Aug 12 06:56:45.373542 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 522/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:45 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:46.396620 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1beff3ef-ed58-479a-a7b1-a51a3c31bf97 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:46.397208 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1beff3ef-ed58-479a-a7b1-a51a3c31bf97 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:46.403999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1beff3ef-ed58-479a-a7b1-a51a3c31bf97 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:46.404471 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1beff3ef-ed58-479a-a7b1-a51a3c31bf97 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:46.404900 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1beff3ef-ed58-479a-a7b1-a51a3c31bf97 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:46.405594 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1beff3ef-ed58-479a-a7b1-a51a3c31bf97 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:46.406049 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1beff3ef-ed58-479a-a7b1-a51a3c31bf97 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:46.406471 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1beff3ef-ed58-479a-a7b1-a51a3c31bf97 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:46.536608 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1beff3ef-ed58-479a-a7b1-a51a3c31bf97 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:46.544250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1beff3ef-ed58-479a-a7b1-a51a3c31bf97 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1259 microversion: 2.1 time: 0.153078 Aug 12 06:56:46.544828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 491/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:46 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:47.565800 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fabaa279-91d7-4dec-b6d3-fe61590a673f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:47.566600 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fabaa279-91d7-4dec-b6d3-fe61590a673f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:47.573478 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fabaa279-91d7-4dec-b6d3-fe61590a673f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:47.573972 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fabaa279-91d7-4dec-b6d3-fe61590a673f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:47.574380 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fabaa279-91d7-4dec-b6d3-fe61590a673f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:47.575092 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fabaa279-91d7-4dec-b6d3-fe61590a673f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:47.575542 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fabaa279-91d7-4dec-b6d3-fe61590a673f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:47.575964 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fabaa279-91d7-4dec-b6d3-fe61590a673f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:47.714014 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fabaa279-91d7-4dec-b6d3-fe61590a673f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:47.724197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fabaa279-91d7-4dec-b6d3-fe61590a673f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1259 microversion: 2.1 time: 0.162363 Aug 12 06:56:47.724866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 523/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:47 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:48.748766 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2375eff4-f041-49db-9f42-6fb44636c0b9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:48.749793 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2375eff4-f041-49db-9f42-6fb44636c0b9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:48.752947 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:48.753986 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:48.759959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375eff4-f041-49db-9f42-6fb44636c0b9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:48.760431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375eff4-f041-49db-9f42-6fb44636c0b9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:48.760852 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375eff4-f041-49db-9f42-6fb44636c0b9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:48.761565 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375eff4-f041-49db-9f42-6fb44636c0b9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:48.762005 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375eff4-f041-49db-9f42-6fb44636c0b9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:48.762419 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2375eff4-f041-49db-9f42-6fb44636c0b9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:48.896722 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2375eff4-f041-49db-9f42-6fb44636c0b9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:48.904319 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2375eff4-f041-49db-9f42-6fb44636c0b9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1259 microversion: 2.1 time: 0.162514 Aug 12 06:56:48.904920 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 492/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:48 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:49.929320 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c602f52e-5bbc-487e-b9f9-bb013eb6f10a tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:49.930354 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c602f52e-5bbc-487e-b9f9-bb013eb6f10a tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:49.933484 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:56:49.943375 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c602f52e-5bbc-487e-b9f9-bb013eb6f10a tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:49.944218 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c602f52e-5bbc-487e-b9f9-bb013eb6f10a tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:49.945012 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c602f52e-5bbc-487e-b9f9-bb013eb6f10a tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:49.946189 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c602f52e-5bbc-487e-b9f9-bb013eb6f10a tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:49.946934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c602f52e-5bbc-487e-b9f9-bb013eb6f10a tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:49.947667 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c602f52e-5bbc-487e-b9f9-bb013eb6f10a tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:50.099217 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c602f52e-5bbc-487e-b9f9-bb013eb6f10a tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:50.110595 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c602f52e-5bbc-487e-b9f9-bb013eb6f10a tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1259 microversion: 2.1 time: 0.187753 Aug 12 06:56:50.111446 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 524/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:49 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:51.132752 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-17256b1f-38cc-4bcd-82a6-d096892acf9f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:51.134102 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-17256b1f-38cc-4bcd-82a6-d096892acf9f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:51.143225 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17256b1f-38cc-4bcd-82a6-d096892acf9f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:51.144140 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17256b1f-38cc-4bcd-82a6-d096892acf9f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:51.144933 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17256b1f-38cc-4bcd-82a6-d096892acf9f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:51.145757 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17256b1f-38cc-4bcd-82a6-d096892acf9f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:51.146417 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17256b1f-38cc-4bcd-82a6-d096892acf9f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:51.147206 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-17256b1f-38cc-4bcd-82a6-d096892acf9f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:51.263827 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-2d11a2cd-4951-43cc-92eb-c5940a348115 req-1fae6ea2-1157-4ddf-8b4b-9c31e4387674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397bc232-8dd0-4925-89b3-7f2cd5a06dd5", "name": "network-vif-plugged", "status": "completed", "tag": "7022fc1a-cc3e-4c75-84ac-18933a74f704"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:51.276309 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2d11a2cd-4951-43cc-92eb-c5940a348115 req-1fae6ea2-1157-4ddf-8b4b-9c31e4387674 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:51.276868 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2d11a2cd-4951-43cc-92eb-c5940a348115 req-1fae6ea2-1157-4ddf-8b4b-9c31e4387674 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:51.277371 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2d11a2cd-4951-43cc-92eb-c5940a348115 req-1fae6ea2-1157-4ddf-8b4b-9c31e4387674 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:51.291308 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-2d11a2cd-4951-43cc-92eb-c5940a348115 req-1fae6ea2-1157-4ddf-8b4b-9c31e4387674 service nova] Creating event network-vif-plugged:7022fc1a-cc3e-4c75-84ac-18933a74f704 for instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 on hv-cinder-84457 Aug 12 06:56:51.296994 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-2d11a2cd-4951-43cc-92eb-c5940a348115 req-1fae6ea2-1157-4ddf-8b4b-9c31e4387674 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037032 Aug 12 06:56:51.298793 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 525/1017] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 06:56:51.320619 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-17256b1f-38cc-4bcd-82a6-d096892acf9f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:51.328496 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-17256b1f-38cc-4bcd-82a6-d096892acf9f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1259 microversion: 2.1 time: 0.200406 Aug 12 06:56:51.329072 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 493/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:51 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:52.349729 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-210974af-d4fa-41e4-ba31-a41f16c0a2fe tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:52.350412 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-210974af-d4fa-41e4-ba31-a41f16c0a2fe tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:52.357127 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-210974af-d4fa-41e4-ba31-a41f16c0a2fe tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:52.357614 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-210974af-d4fa-41e4-ba31-a41f16c0a2fe tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:52.358051 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-210974af-d4fa-41e4-ba31-a41f16c0a2fe tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:52.358957 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-210974af-d4fa-41e4-ba31-a41f16c0a2fe tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:52.359512 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-210974af-d4fa-41e4-ba31-a41f16c0a2fe tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:52.359937 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-210974af-d4fa-41e4-ba31-a41f16c0a2fe tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:52.498718 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-210974af-d4fa-41e4-ba31-a41f16c0a2fe tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:52.507005 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-210974af-d4fa-41e4-ba31-a41f16c0a2fe tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1259 microversion: 2.1 time: 0.161876 Aug 12 06:56:52.507700 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 526/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:52 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:53.529167 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2ece50f5-c90f-4571-940b-faeaf41e3759 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:53.529867 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2ece50f5-c90f-4571-940b-faeaf41e3759 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:53.537091 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ece50f5-c90f-4571-940b-faeaf41e3759 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:53.537582 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ece50f5-c90f-4571-940b-faeaf41e3759 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:53.538017 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ece50f5-c90f-4571-940b-faeaf41e3759 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:53.538714 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ece50f5-c90f-4571-940b-faeaf41e3759 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:53.539199 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ece50f5-c90f-4571-940b-faeaf41e3759 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:53.539612 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2ece50f5-c90f-4571-940b-faeaf41e3759 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:53.682355 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2ece50f5-c90f-4571-940b-faeaf41e3759 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:53.690926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2ece50f5-c90f-4571-940b-faeaf41e3759 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1443 microversion: 2.1 time: 0.165564 Aug 12 06:56:53.691853 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 494/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:53 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:53.711737 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-116b5170-84f2-4824-b013-a9d51abec876 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:56:53.712970 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-116b5170-84f2-4824-b013-a9d51abec876 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:56:53.720850 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116b5170-84f2-4824-b013-a9d51abec876 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:53.721494 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116b5170-84f2-4824-b013-a9d51abec876 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:53.722191 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116b5170-84f2-4824-b013-a9d51abec876 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:53.723347 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116b5170-84f2-4824-b013-a9d51abec876 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:53.723891 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116b5170-84f2-4824-b013-a9d51abec876 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:53.724396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116b5170-84f2-4824-b013-a9d51abec876 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:53.863933 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-116b5170-84f2-4824-b013-a9d51abec876 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:56:53.872120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-116b5170-84f2-4824-b013-a9d51abec876 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1443 microversion: 2.1 time: 0.164379 Aug 12 06:56:53.872841 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 527/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:56:53 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:56:55.907482 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-30fde62d-04fb-48da-9802-8651cdc13776 req-e5ee4fad-4b39-4909-8393-b94e9063aa0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397bc232-8dd0-4925-89b3-7f2cd5a06dd5", "tag": "7022fc1a-cc3e-4c75-84ac-18933a74f704"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:56:55.918099 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-30fde62d-04fb-48da-9802-8651cdc13776 req-e5ee4fad-4b39-4909-8393-b94e9063aa0e service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:56:55.918099 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-30fde62d-04fb-48da-9802-8651cdc13776 req-e5ee4fad-4b39-4909-8393-b94e9063aa0e service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:56:55.918516 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-30fde62d-04fb-48da-9802-8651cdc13776 req-e5ee4fad-4b39-4909-8393-b94e9063aa0e service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:56:55.930339 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-30fde62d-04fb-48da-9802-8651cdc13776 req-e5ee4fad-4b39-4909-8393-b94e9063aa0e service nova] Creating event network-changed:7022fc1a-cc3e-4c75-84ac-18933a74f704 for instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 on hv-cinder-84457 Aug 12 06:56:55.938425 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-30fde62d-04fb-48da-9802-8651cdc13776 req-e5ee4fad-4b39-4909-8393-b94e9063aa0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031650 Aug 12 06:56:55.939249 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 495/1022] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:58:03.463285 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 06:58:03.464298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Fri Aug 12 06:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 06:58:20.504934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:58:20.506259 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:58:20.513139 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-19b9f70f-b7d9-4713-a4d5-f3e033ddbeda tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:20.513988 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-19b9f70f-b7d9-4713-a4d5-f3e033ddbeda tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:20.522359 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b9f70f-b7d9-4713-a4d5-f3e033ddbeda tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:20.522843 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b9f70f-b7d9-4713-a4d5-f3e033ddbeda tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:20.523301 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b9f70f-b7d9-4713-a4d5-f3e033ddbeda tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:20.523996 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b9f70f-b7d9-4713-a4d5-f3e033ddbeda tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:20.524442 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b9f70f-b7d9-4713-a4d5-f3e033ddbeda tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:20.524859 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19b9f70f-b7d9-4713-a4d5-f3e033ddbeda tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:20.550817 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-19b9f70f-b7d9-4713-a4d5-f3e033ddbeda tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 06:58:20.636045 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-19b9f70f-b7d9-4713-a4d5-f3e033ddbeda tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "DELETE /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 204 len: 0 microversion: 2.1 time: 0.134377 Aug 12 06:58:20.636834 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 528/1023] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 06:58:20 2022] DELETE /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 06:58:20.644838 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:58:20.645578 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=61 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:58:20.650317 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8130f114-5844-47fc-9c8e-d22dcca8dd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:20.651027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8130f114-5844-47fc-9c8e-d22dcca8dd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:20.658524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8130f114-5844-47fc-9c8e-d22dcca8dd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:20.659026 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8130f114-5844-47fc-9c8e-d22dcca8dd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:20.659460 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8130f114-5844-47fc-9c8e-d22dcca8dd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:20.660147 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8130f114-5844-47fc-9c8e-d22dcca8dd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:20.660597 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8130f114-5844-47fc-9c8e-d22dcca8dd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:20.661018 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8130f114-5844-47fc-9c8e-d22dcca8dd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:20.968102 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8130f114-5844-47fc-9c8e-d22dcca8dd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:20.976100 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8130f114-5844-47fc-9c8e-d22dcca8dd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1576 microversion: 2.1 time: 0.333641 Aug 12 06:58:20.976662 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 496/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:20 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1576 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:22.002283 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5060d699-b505-4f07-90ac-7b1966c3ae25 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:22.003457 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5060d699-b505-4f07-90ac-7b1966c3ae25 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:22.014677 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5060d699-b505-4f07-90ac-7b1966c3ae25 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:22.015199 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5060d699-b505-4f07-90ac-7b1966c3ae25 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:22.015596 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5060d699-b505-4f07-90ac-7b1966c3ae25 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:22.016315 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5060d699-b505-4f07-90ac-7b1966c3ae25 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:22.016765 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5060d699-b505-4f07-90ac-7b1966c3ae25 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:22.017181 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5060d699-b505-4f07-90ac-7b1966c3ae25 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:22.216942 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5060d699-b505-4f07-90ac-7b1966c3ae25 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:22.225721 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5060d699-b505-4f07-90ac-7b1966c3ae25 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1576 microversion: 2.1 time: 0.230662 Aug 12 06:58:22.226334 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 529/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:21 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:23.254927 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8677c222-9f15-47e5-8257-ac2dde8e7e51 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:23.256324 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8677c222-9f15-47e5-8257-ac2dde8e7e51 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:23.263624 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8677c222-9f15-47e5-8257-ac2dde8e7e51 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:23.264493 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8677c222-9f15-47e5-8257-ac2dde8e7e51 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:23.265202 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8677c222-9f15-47e5-8257-ac2dde8e7e51 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:23.265986 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8677c222-9f15-47e5-8257-ac2dde8e7e51 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:23.266564 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8677c222-9f15-47e5-8257-ac2dde8e7e51 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:23.267040 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8677c222-9f15-47e5-8257-ac2dde8e7e51 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:23.404134 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8677c222-9f15-47e5-8257-ac2dde8e7e51 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:23.412344 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8677c222-9f15-47e5-8257-ac2dde8e7e51 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 200 len: 1508 microversion: 2.1 time: 0.161309 Aug 12 06:58:23.412810 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 497/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:23 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:23.471940 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-ce81b0e0-b1d6-41e7-bb75-8c373e02ef74 req-b29bec53-8934-4f01-bb98-0aab81b3b3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a9065d-a53f-4325-b7eb-a0aad221c075", "name": "network-vif-deleted", "tag": "f93c3d68-b767-428a-9306-42ffdec5cf15"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:58:23.482136 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ce81b0e0-b1d6-41e7-bb75-8c373e02ef74 req-b29bec53-8934-4f01-bb98-0aab81b3b3eb service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:23.482533 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ce81b0e0-b1d6-41e7-bb75-8c373e02ef74 req-b29bec53-8934-4f01-bb98-0aab81b3b3eb service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:23.483014 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ce81b0e0-b1d6-41e7-bb75-8c373e02ef74 req-b29bec53-8934-4f01-bb98-0aab81b3b3eb service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:23.494659 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-ce81b0e0-b1d6-41e7-bb75-8c373e02ef74 req-b29bec53-8934-4f01-bb98-0aab81b3b3eb service nova] Creating event network-vif-deleted:f93c3d68-b767-428a-9306-42ffdec5cf15 for instance 86a9065d-a53f-4325-b7eb-a0aad221c075 on hv-cinder-84457 Aug 12 06:58:23.505342 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-ce81b0e0-b1d6-41e7-bb75-8c373e02ef74 req-b29bec53-8934-4f01-bb98-0aab81b3b3eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036357 Aug 12 06:58:23.506793 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 530/1027] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:58:24.434279 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:24.435101 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:24.442468 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:24.443143 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:24.443572 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:24.444308 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:24.444793 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:24.445206 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:24.459495 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] HTTP exception thrown: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Request method failure captured: Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 HTTP/1.1 Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fldNnheDuqto9f8GrufaZ6yGBiqB3Gvc_LnV5CZ3Wv-f_rurzDTfUHqyQUQjMmTi56kA9zobZ7pCtfCmzHpy22fmpjgSoaP3Z7MPH386hXOrgkHVV7evHsV3nA53eB0-41x_sfDc1nUVGCRBF9vPa4aEjj75boJPvfqr8CeFfJ2D_Y Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 64466d34729c44908afad2679c99d439 Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-TestVolumeBootPattern-1372693688 Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 06:58:24.461198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64466d34729c44908afad2679c99d439", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64466d34729c44908afad2679c99d439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64466d34729c44908afad2679c99d439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64466d34729c44908afad2679c99d439"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-TestVolumeBootPattern-1372693688 Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 64466d34729c44908afad2679c99d439 Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-TestVolumeBootPattern-1372693688 Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-TestVolumeBootPattern-1372693688-project Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 5138389f1535438d8380cf6cc9bd891b Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-TestVolumeBootPattern-1372693688-project Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 06:58:24.462999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '86a9065d-a53f-4325-b7eb-a0aad221c075'} Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 06:58:24.463987 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 06:58:24.465490 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 06:58:24.466792 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Returning 404 to user: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 06:58:24.466792 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ab8a99f8-5e5e-4868-8b93-b37db09c1cd3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 404 len: 111 microversion: 2.1 time: 0.032590 Aug 12 06:58:24.466792 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 498/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:24 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 06:58:24.566621 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1109646951", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-271553105", "security_groups": [{"name": "tempest-secgroup-smoke-2135118312"}], "block_device_mapping_v2": [{"uuid": "361af7a6-95a4-473d-a7da-5f5a60bfeb01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8101570f-07e2-43c5-a2c5-9493f86335a2"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:58:24.683066 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] validate_networks() for [('8101570f-07e2-43c5-a2c5-9493f86335a2', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 06:58:25.143046 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 06:58:25.143763 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 06:58:25.144490 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 06:58:25.145149 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 06:58:25.145830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 06:58:25.157912 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:25.158388 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:25.158821 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:25.159577 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:25.160023 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:25.160438 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:25.177391 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Getting quotas for project 64466d34729c44908afad2679c99d439. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 06:58:25.181734 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Getting quotas for user 5138389f1535438d8380cf6cc9bd891b and project 64466d34729c44908afad2679c99d439. Resources: {'cores', 'ram', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 06:58:25.240039 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 06:58:25.242209 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='361af7a6-95a4-473d-a7da-5f5a60bfeb01',volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 06:58:25.373828 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-680d5568-ba9e-4b7f-85ac-28040e3a552b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.814095 Aug 12 06:58:25.374473 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 531/1029] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 06:58:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 06:58:25.385432 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-30fd0fee-a0f3-42a3-ad84-7b123911a554 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:25.386073 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-30fd0fee-a0f3-42a3-ad84-7b123911a554 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:25.439638 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-30fd0fee-a0f3-42a3-ad84-7b123911a554 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:25.450516 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-30fd0fee-a0f3-42a3-ad84-7b123911a554 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1094 microversion: 2.1 time: 0.068405 Aug 12 06:58:25.450870 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 499/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:25 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:26.470422 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-28b4b693-8cd3-493b-a1d5-8d2efef39221 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:26.471048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-28b4b693-8cd3-493b-a1d5-8d2efef39221 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:26.477570 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28b4b693-8cd3-493b-a1d5-8d2efef39221 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:26.478056 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28b4b693-8cd3-493b-a1d5-8d2efef39221 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:26.478674 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28b4b693-8cd3-493b-a1d5-8d2efef39221 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:26.479401 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28b4b693-8cd3-493b-a1d5-8d2efef39221 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:26.479847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28b4b693-8cd3-493b-a1d5-8d2efef39221 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:26.480259 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28b4b693-8cd3-493b-a1d5-8d2efef39221 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:26.579412 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-28b4b693-8cd3-493b-a1d5-8d2efef39221 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:26.588703 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-28b4b693-8cd3-493b-a1d5-8d2efef39221 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1200 microversion: 2.1 time: 0.122697 Aug 12 06:58:26.589254 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 532/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:26 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1200 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:27.610661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-513c8ffd-739b-49ae-aeda-df0622b747e5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:27.611320 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-513c8ffd-739b-49ae-aeda-df0622b747e5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:27.619532 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-513c8ffd-739b-49ae-aeda-df0622b747e5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:27.620412 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-513c8ffd-739b-49ae-aeda-df0622b747e5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:27.620971 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-513c8ffd-739b-49ae-aeda-df0622b747e5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:27.621980 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-513c8ffd-739b-49ae-aeda-df0622b747e5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:27.622414 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-513c8ffd-739b-49ae-aeda-df0622b747e5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:27.622836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-513c8ffd-739b-49ae-aeda-df0622b747e5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:27.827947 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-513c8ffd-739b-49ae-aeda-df0622b747e5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:27.836335 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-513c8ffd-739b-49ae-aeda-df0622b747e5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1266 microversion: 2.1 time: 0.230014 Aug 12 06:58:27.836903 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 500/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:27 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:28.053215 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-c79c806f-2386-4492-8213-baa42e16c97d req-fdcff7fb-354c-4384-b7b7-dc28f7cce235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217dedfb-803a-4cca-8170-2b381b9bc4a9", "tag": "4bab8d1c-fe10-44f2-b00b-23441af1c226"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:58:28.064444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c79c806f-2386-4492-8213-baa42e16c97d req-fdcff7fb-354c-4384-b7b7-dc28f7cce235 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:28.064930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c79c806f-2386-4492-8213-baa42e16c97d req-fdcff7fb-354c-4384-b7b7-dc28f7cce235 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:28.065389 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c79c806f-2386-4492-8213-baa42e16c97d req-fdcff7fb-354c-4384-b7b7-dc28f7cce235 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:28.076995 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-c79c806f-2386-4492-8213-baa42e16c97d req-fdcff7fb-354c-4384-b7b7-dc28f7cce235 service nova] Creating event network-changed:4bab8d1c-fe10-44f2-b00b-23441af1c226 for instance 217dedfb-803a-4cca-8170-2b381b9bc4a9 on hv-cinder-84457 Aug 12 06:58:28.081846 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-c79c806f-2386-4492-8213-baa42e16c97d req-fdcff7fb-354c-4384-b7b7-dc28f7cce235 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032619 Aug 12 06:58:28.082434 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 533/1033] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:58:28.858623 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7f42a954-b130-469c-973d-d5047c9bd6a5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:28.859098 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7f42a954-b130-469c-973d-d5047c9bd6a5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:28.865706 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7f42a954-b130-469c-973d-d5047c9bd6a5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:28.866192 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7f42a954-b130-469c-973d-d5047c9bd6a5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:28.866743 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7f42a954-b130-469c-973d-d5047c9bd6a5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:28.867481 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7f42a954-b130-469c-973d-d5047c9bd6a5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:28.867935 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7f42a954-b130-469c-973d-d5047c9bd6a5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:28.868355 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7f42a954-b130-469c-973d-d5047c9bd6a5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:29.076664 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7f42a954-b130-469c-973d-d5047c9bd6a5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:29.084587 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7f42a954-b130-469c-973d-d5047c9bd6a5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1266 microversion: 2.1 time: 0.230578 Aug 12 06:58:29.085212 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 501/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:28 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:30.110932 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-41871dd1-70d2-4f70-89d3-6c4fa4923096 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:30.111964 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-41871dd1-70d2-4f70-89d3-6c4fa4923096 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:30.119815 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41871dd1-70d2-4f70-89d3-6c4fa4923096 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:30.120416 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41871dd1-70d2-4f70-89d3-6c4fa4923096 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:30.120959 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41871dd1-70d2-4f70-89d3-6c4fa4923096 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:30.121818 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41871dd1-70d2-4f70-89d3-6c4fa4923096 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:30.122383 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41871dd1-70d2-4f70-89d3-6c4fa4923096 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:30.122908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41871dd1-70d2-4f70-89d3-6c4fa4923096 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:30.266963 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-41871dd1-70d2-4f70-89d3-6c4fa4923096 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:30.275195 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-41871dd1-70d2-4f70-89d3-6c4fa4923096 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1266 microversion: 2.1 time: 0.171580 Aug 12 06:58:30.275798 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 534/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:30 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:31.301149 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-579672cf-7219-460c-aa82-e12409f11396 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:31.302705 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-579672cf-7219-460c-aa82-e12409f11396 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:31.314541 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-579672cf-7219-460c-aa82-e12409f11396 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:31.315052 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-579672cf-7219-460c-aa82-e12409f11396 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:31.315501 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-579672cf-7219-460c-aa82-e12409f11396 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:31.316186 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-579672cf-7219-460c-aa82-e12409f11396 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:31.316638 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-579672cf-7219-460c-aa82-e12409f11396 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:31.317059 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-579672cf-7219-460c-aa82-e12409f11396 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:31.455408 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-579672cf-7219-460c-aa82-e12409f11396 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:31.462910 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-579672cf-7219-460c-aa82-e12409f11396 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1266 microversion: 2.1 time: 0.169483 Aug 12 06:58:31.463483 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 502/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:31 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:32.487904 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-aa895143-e6e4-4b88-b1fd-7625844df0ff tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:32.488587 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-aa895143-e6e4-4b88-b1fd-7625844df0ff tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:32.495798 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa895143-e6e4-4b88-b1fd-7625844df0ff tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:32.496310 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa895143-e6e4-4b88-b1fd-7625844df0ff tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:32.496773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa895143-e6e4-4b88-b1fd-7625844df0ff tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:32.497498 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa895143-e6e4-4b88-b1fd-7625844df0ff tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:32.497974 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa895143-e6e4-4b88-b1fd-7625844df0ff tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:32.498423 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa895143-e6e4-4b88-b1fd-7625844df0ff tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:32.643477 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aa895143-e6e4-4b88-b1fd-7625844df0ff tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:32.657470 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-aa895143-e6e4-4b88-b1fd-7625844df0ff tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1266 microversion: 2.1 time: 0.174429 Aug 12 06:58:32.658052 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 535/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:32 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:33.682708 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3e740045-a16f-489e-bcb8-299abda43c56 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:33.683747 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3e740045-a16f-489e-bcb8-299abda43c56 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:33.692037 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3e740045-a16f-489e-bcb8-299abda43c56 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:33.692514 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3e740045-a16f-489e-bcb8-299abda43c56 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:33.692942 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3e740045-a16f-489e-bcb8-299abda43c56 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:33.693629 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3e740045-a16f-489e-bcb8-299abda43c56 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:33.694073 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3e740045-a16f-489e-bcb8-299abda43c56 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:33.694487 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3e740045-a16f-489e-bcb8-299abda43c56 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:33.837284 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3e740045-a16f-489e-bcb8-299abda43c56 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:33.845606 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3e740045-a16f-489e-bcb8-299abda43c56 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1266 microversion: 2.1 time: 0.169456 Aug 12 06:58:33.846181 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 503/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:33 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:34.869922 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0d31358d-ca18-47af-a631-c4602f6c363d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:34.870786 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0d31358d-ca18-47af-a631-c4602f6c363d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:34.879236 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0d31358d-ca18-47af-a631-c4602f6c363d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:34.879715 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0d31358d-ca18-47af-a631-c4602f6c363d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:34.880129 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0d31358d-ca18-47af-a631-c4602f6c363d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:34.880807 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0d31358d-ca18-47af-a631-c4602f6c363d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:34.881244 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0d31358d-ca18-47af-a631-c4602f6c363d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:34.881654 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0d31358d-ca18-47af-a631-c4602f6c363d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:35.026335 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0d31358d-ca18-47af-a631-c4602f6c363d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:35.034532 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0d31358d-ca18-47af-a631-c4602f6c363d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1266 microversion: 2.1 time: 0.171267 Aug 12 06:58:35.035121 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 536/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:34 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:36.062054 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b8d2c23a-3cc5-4615-a3d5-9c281e25e888 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:36.062754 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b8d2c23a-3cc5-4615-a3d5-9c281e25e888 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:36.065226 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:58:36.070851 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b8d2c23a-3cc5-4615-a3d5-9c281e25e888 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:36.071329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b8d2c23a-3cc5-4615-a3d5-9c281e25e888 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:36.071751 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b8d2c23a-3cc5-4615-a3d5-9c281e25e888 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:36.072458 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b8d2c23a-3cc5-4615-a3d5-9c281e25e888 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:36.072927 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b8d2c23a-3cc5-4615-a3d5-9c281e25e888 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:36.073340 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b8d2c23a-3cc5-4615-a3d5-9c281e25e888 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:36.207618 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b8d2c23a-3cc5-4615-a3d5-9c281e25e888 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:36.215211 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b8d2c23a-3cc5-4615-a3d5-9c281e25e888 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1266 microversion: 2.1 time: 0.157188 Aug 12 06:58:36.215836 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 504/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:36 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:37.241584 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-13a0987f-a40b-47f0-9ae4-46536f52fabe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:37.242602 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-13a0987f-a40b-47f0-9ae4-46536f52fabe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:37.245735 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:58:37.246821 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:58:37.255755 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a0987f-a40b-47f0-9ae4-46536f52fabe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:37.256234 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a0987f-a40b-47f0-9ae4-46536f52fabe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:37.256664 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a0987f-a40b-47f0-9ae4-46536f52fabe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:37.257386 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a0987f-a40b-47f0-9ae4-46536f52fabe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:37.257819 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a0987f-a40b-47f0-9ae4-46536f52fabe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:37.258251 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a0987f-a40b-47f0-9ae4-46536f52fabe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:37.391008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-13a0987f-a40b-47f0-9ae4-46536f52fabe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:37.398690 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-13a0987f-a40b-47f0-9ae4-46536f52fabe tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1266 microversion: 2.1 time: 0.164532 Aug 12 06:58:37.399290 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 537/1041] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:37 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:37.764168 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-93c36314-3a06-4ed2-ad94-cacecc5a9c95 req-a8f58ec3-2e7a-4cdf-b370-4801a968afa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217dedfb-803a-4cca-8170-2b381b9bc4a9", "name": "network-vif-plugged", "status": "completed", "tag": "4bab8d1c-fe10-44f2-b00b-23441af1c226"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:58:37.774542 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-93c36314-3a06-4ed2-ad94-cacecc5a9c95 req-a8f58ec3-2e7a-4cdf-b370-4801a968afa4 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:37.775018 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-93c36314-3a06-4ed2-ad94-cacecc5a9c95 req-a8f58ec3-2e7a-4cdf-b370-4801a968afa4 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:37.775469 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-93c36314-3a06-4ed2-ad94-cacecc5a9c95 req-a8f58ec3-2e7a-4cdf-b370-4801a968afa4 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:37.786479 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-93c36314-3a06-4ed2-ad94-cacecc5a9c95 req-a8f58ec3-2e7a-4cdf-b370-4801a968afa4 service nova] Creating event network-vif-plugged:4bab8d1c-fe10-44f2-b00b-23441af1c226 for instance 217dedfb-803a-4cca-8170-2b381b9bc4a9 on hv-cinder-84457 Aug 12 06:58:37.791672 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-93c36314-3a06-4ed2-ad94-cacecc5a9c95 req-a8f58ec3-2e7a-4cdf-b370-4801a968afa4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091777 Aug 12 06:58:37.792292 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 505/1042] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:58:38.423048 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-84653721-3412-4c39-9502-46aa4d07f15b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:38.423956 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-84653721-3412-4c39-9502-46aa4d07f15b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:38.431739 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84653721-3412-4c39-9502-46aa4d07f15b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:38.432389 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84653721-3412-4c39-9502-46aa4d07f15b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:38.433088 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84653721-3412-4c39-9502-46aa4d07f15b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:38.433962 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84653721-3412-4c39-9502-46aa4d07f15b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:38.434471 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84653721-3412-4c39-9502-46aa4d07f15b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:38.435075 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84653721-3412-4c39-9502-46aa4d07f15b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:38.570263 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-84653721-3412-4c39-9502-46aa4d07f15b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:38.578339 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-84653721-3412-4c39-9502-46aa4d07f15b tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1266 microversion: 2.1 time: 0.162035 Aug 12 06:58:38.578908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 538/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:38 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:39.599909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-24ed3d0c-0b96-4a6e-aafc-db33aa532a41 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:39.600615 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-24ed3d0c-0b96-4a6e-aafc-db33aa532a41 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:39.607476 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24ed3d0c-0b96-4a6e-aafc-db33aa532a41 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:39.607959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24ed3d0c-0b96-4a6e-aafc-db33aa532a41 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:39.608396 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24ed3d0c-0b96-4a6e-aafc-db33aa532a41 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:39.609081 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24ed3d0c-0b96-4a6e-aafc-db33aa532a41 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:39.609535 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24ed3d0c-0b96-4a6e-aafc-db33aa532a41 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:39.609954 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24ed3d0c-0b96-4a6e-aafc-db33aa532a41 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:39.749222 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-24ed3d0c-0b96-4a6e-aafc-db33aa532a41 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:39.757282 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-24ed3d0c-0b96-4a6e-aafc-db33aa532a41 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1452 microversion: 2.1 time: 0.162272 Aug 12 06:58:39.757856 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 506/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:39 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:39.777837 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-226ff83d-f8ec-4a99-990c-1d7cc3bf72ed tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:39.778382 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-226ff83d-f8ec-4a99-990c-1d7cc3bf72ed tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:39.785848 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-226ff83d-f8ec-4a99-990c-1d7cc3bf72ed tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:39.786329 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-226ff83d-f8ec-4a99-990c-1d7cc3bf72ed tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:39.786761 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-226ff83d-f8ec-4a99-990c-1d7cc3bf72ed tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:39.787482 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-226ff83d-f8ec-4a99-990c-1d7cc3bf72ed tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:39.787934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-226ff83d-f8ec-4a99-990c-1d7cc3bf72ed tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:39.788350 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-226ff83d-f8ec-4a99-990c-1d7cc3bf72ed tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:39.927000 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-226ff83d-f8ec-4a99-990c-1d7cc3bf72ed tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:39.935365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-226ff83d-f8ec-4a99-990c-1d7cc3bf72ed tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1452 microversion: 2.1 time: 0.161480 Aug 12 06:58:39.935938 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 539/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:39 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:41.860971 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-ca4eb099-5c48-465d-80f3-808a52a7a47d req-8cd8b6aa-7925-4d52-bb10-deb6ecb90474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217dedfb-803a-4cca-8170-2b381b9bc4a9", "tag": "4bab8d1c-fe10-44f2-b00b-23441af1c226"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:58:41.870705 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ca4eb099-5c48-465d-80f3-808a52a7a47d req-8cd8b6aa-7925-4d52-bb10-deb6ecb90474 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:41.871862 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ca4eb099-5c48-465d-80f3-808a52a7a47d req-8cd8b6aa-7925-4d52-bb10-deb6ecb90474 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:41.872288 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ca4eb099-5c48-465d-80f3-808a52a7a47d req-8cd8b6aa-7925-4d52-bb10-deb6ecb90474 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:41.883959 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-ca4eb099-5c48-465d-80f3-808a52a7a47d req-8cd8b6aa-7925-4d52-bb10-deb6ecb90474 service nova] Creating event network-changed:4bab8d1c-fe10-44f2-b00b-23441af1c226 for instance 217dedfb-803a-4cca-8170-2b381b9bc4a9 on hv-cinder-84457 Aug 12 06:58:41.889174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-ca4eb099-5c48-465d-80f3-808a52a7a47d req-8cd8b6aa-7925-4d52-bb10-deb6ecb90474 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088982 Aug 12 06:58:41.890340 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 507/1046] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:58:51.060076 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7df5065a-d701-40bc-8143-946efe135380 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:58:51.060846 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7df5065a-d701-40bc-8143-946efe135380 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:51.063977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:58:51.064807 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:58:51.072712 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7df5065a-d701-40bc-8143-946efe135380 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:51.073317 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7df5065a-d701-40bc-8143-946efe135380 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:51.073855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7df5065a-d701-40bc-8143-946efe135380 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:51.074711 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7df5065a-d701-40bc-8143-946efe135380 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:51.075635 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7df5065a-d701-40bc-8143-946efe135380 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:51.076157 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7df5065a-d701-40bc-8143-946efe135380 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:51.102528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-7df5065a-d701-40bc-8143-946efe135380 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lazy-loading 'flavor' on Instance uuid 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 06:58:51.185794 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7df5065a-d701-40bc-8143-946efe135380 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "POST /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5/action" status: 202 len: 0 microversion: 2.1 time: 0.130651 Aug 12 06:58:51.186365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 540/1047] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:58:51 2022] POST /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:58:51.195754 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bee8efd0-c82d-4ba5-a6a3-7eeb9df63786 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:51.196496 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bee8efd0-c82d-4ba5-a6a3-7eeb9df63786 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:51.198862 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=27 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:58:51.205050 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bee8efd0-c82d-4ba5-a6a3-7eeb9df63786 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:51.205516 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bee8efd0-c82d-4ba5-a6a3-7eeb9df63786 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:51.205953 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bee8efd0-c82d-4ba5-a6a3-7eeb9df63786 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:51.206790 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bee8efd0-c82d-4ba5-a6a3-7eeb9df63786 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:51.207374 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bee8efd0-c82d-4ba5-a6a3-7eeb9df63786 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:51.207896 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bee8efd0-c82d-4ba5-a6a3-7eeb9df63786 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:51.212341 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=55 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:58:51.356157 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bee8efd0-c82d-4ba5-a6a3-7eeb9df63786 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:51.365363 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bee8efd0-c82d-4ba5-a6a3-7eeb9df63786 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.174168 Aug 12 06:58:51.365994 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 508/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:51 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 06:58:52.391975 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-789c1ba1-4ca7-4c33-8fc8-4faaab2f16a9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:52.392693 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-789c1ba1-4ca7-4c33-8fc8-4faaab2f16a9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:52.400226 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-789c1ba1-4ca7-4c33-8fc8-4faaab2f16a9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:52.400702 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-789c1ba1-4ca7-4c33-8fc8-4faaab2f16a9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:52.401125 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-789c1ba1-4ca7-4c33-8fc8-4faaab2f16a9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:52.401804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-789c1ba1-4ca7-4c33-8fc8-4faaab2f16a9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:52.402248 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-789c1ba1-4ca7-4c33-8fc8-4faaab2f16a9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:52.402665 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-789c1ba1-4ca7-4c33-8fc8-4faaab2f16a9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:52.548124 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-789c1ba1-4ca7-4c33-8fc8-4faaab2f16a9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:52.555978 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-789c1ba1-4ca7-4c33-8fc8-4faaab2f16a9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.171896 Aug 12 06:58:52.556553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 541/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:52 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:53.581113 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-661a482b-9e30-41c1-a6dc-b36ca68ca672 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:53.582054 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-661a482b-9e30-41c1-a6dc-b36ca68ca672 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:53.592920 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-661a482b-9e30-41c1-a6dc-b36ca68ca672 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:53.593708 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-661a482b-9e30-41c1-a6dc-b36ca68ca672 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:53.594451 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-661a482b-9e30-41c1-a6dc-b36ca68ca672 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:53.595617 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-661a482b-9e30-41c1-a6dc-b36ca68ca672 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:53.596358 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-661a482b-9e30-41c1-a6dc-b36ca68ca672 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:53.597053 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-661a482b-9e30-41c1-a6dc-b36ca68ca672 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:53.754799 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-661a482b-9e30-41c1-a6dc-b36ca68ca672 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:53.762934 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-661a482b-9e30-41c1-a6dc-b36ca68ca672 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.188302 Aug 12 06:58:53.763554 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 509/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:53 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:54.788708 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-57cb3ee9-5ec7-49fb-884f-d442d924c263 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:54.789580 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-57cb3ee9-5ec7-49fb-884f-d442d924c263 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:54.799801 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57cb3ee9-5ec7-49fb-884f-d442d924c263 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:54.800596 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57cb3ee9-5ec7-49fb-884f-d442d924c263 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:54.801297 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57cb3ee9-5ec7-49fb-884f-d442d924c263 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:54.802439 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57cb3ee9-5ec7-49fb-884f-d442d924c263 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:54.803257 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57cb3ee9-5ec7-49fb-884f-d442d924c263 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:54.803678 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57cb3ee9-5ec7-49fb-884f-d442d924c263 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:54.944589 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-57cb3ee9-5ec7-49fb-884f-d442d924c263 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:54.952831 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-57cb3ee9-5ec7-49fb-884f-d442d924c263 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.171242 Aug 12 06:58:54.953397 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 542/1051] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:54 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:55.977928 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f915134b-2d1e-487d-9c4e-52d01cc2d80c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:55.978927 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f915134b-2d1e-487d-9c4e-52d01cc2d80c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:55.989669 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f915134b-2d1e-487d-9c4e-52d01cc2d80c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:55.990493 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f915134b-2d1e-487d-9c4e-52d01cc2d80c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:55.991260 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f915134b-2d1e-487d-9c4e-52d01cc2d80c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:55.992390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f915134b-2d1e-487d-9c4e-52d01cc2d80c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:55.993121 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f915134b-2d1e-487d-9c4e-52d01cc2d80c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:55.993817 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f915134b-2d1e-487d-9c4e-52d01cc2d80c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:56.135650 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f915134b-2d1e-487d-9c4e-52d01cc2d80c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:56.147798 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f915134b-2d1e-487d-9c4e-52d01cc2d80c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.176565 Aug 12 06:58:56.148367 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 510/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:55 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:57.170648 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a37acaf2-9345-4cb3-98b7-a18d0e774e8d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:57.171398 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a37acaf2-9345-4cb3-98b7-a18d0e774e8d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:57.179715 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a37acaf2-9345-4cb3-98b7-a18d0e774e8d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:57.180213 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a37acaf2-9345-4cb3-98b7-a18d0e774e8d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:57.180645 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a37acaf2-9345-4cb3-98b7-a18d0e774e8d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:57.181348 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a37acaf2-9345-4cb3-98b7-a18d0e774e8d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:57.181797 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a37acaf2-9345-4cb3-98b7-a18d0e774e8d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:57.182217 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a37acaf2-9345-4cb3-98b7-a18d0e774e8d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:57.326735 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a37acaf2-9345-4cb3-98b7-a18d0e774e8d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:57.334587 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a37acaf2-9345-4cb3-98b7-a18d0e774e8d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.169102 Aug 12 06:58:57.335192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 543/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:57 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:58.359775 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7bc09579-e7f1-4137-b8e7-8de5939df624 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:58.360507 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7bc09579-e7f1-4137-b8e7-8de5939df624 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:58.369354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bc09579-e7f1-4137-b8e7-8de5939df624 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:58.369843 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bc09579-e7f1-4137-b8e7-8de5939df624 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:58.370275 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bc09579-e7f1-4137-b8e7-8de5939df624 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:58.370993 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bc09579-e7f1-4137-b8e7-8de5939df624 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:58.371472 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bc09579-e7f1-4137-b8e7-8de5939df624 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:58.371898 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7bc09579-e7f1-4137-b8e7-8de5939df624 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:58.515621 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7bc09579-e7f1-4137-b8e7-8de5939df624 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:58.525343 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7bc09579-e7f1-4137-b8e7-8de5939df624 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.172133 Aug 12 06:58:58.525888 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 511/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:58 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:58:59.546043 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-50fad7f0-ceb5-48df-bf4b-252df5e9eee0 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:58:59.546638 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-50fad7f0-ceb5-48df-bf4b-252df5e9eee0 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:58:59.553513 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50fad7f0-ceb5-48df-bf4b-252df5e9eee0 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:59.553989 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50fad7f0-ceb5-48df-bf4b-252df5e9eee0 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:59.554414 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50fad7f0-ceb5-48df-bf4b-252df5e9eee0 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:59.555135 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50fad7f0-ceb5-48df-bf4b-252df5e9eee0 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:58:59.555583 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50fad7f0-ceb5-48df-bf4b-252df5e9eee0 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:58:59.555996 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50fad7f0-ceb5-48df-bf4b-252df5e9eee0 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:58:59.698817 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-50fad7f0-ceb5-48df-bf4b-252df5e9eee0 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:58:59.707139 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-50fad7f0-ceb5-48df-bf4b-252df5e9eee0 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.164995 Aug 12 06:58:59.707717 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 544/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:58:59 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:00.729756 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-32fab248-ecfd-4211-8836-30679aa46d69 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:00.730328 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-32fab248-ecfd-4211-8836-30679aa46d69 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:00.737427 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32fab248-ecfd-4211-8836-30679aa46d69 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:00.737918 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32fab248-ecfd-4211-8836-30679aa46d69 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:00.738346 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32fab248-ecfd-4211-8836-30679aa46d69 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:00.739012 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32fab248-ecfd-4211-8836-30679aa46d69 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:00.739500 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32fab248-ecfd-4211-8836-30679aa46d69 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:00.739915 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-32fab248-ecfd-4211-8836-30679aa46d69 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:00.886006 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-32fab248-ecfd-4211-8836-30679aa46d69 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:00.894361 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-32fab248-ecfd-4211-8836-30679aa46d69 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.168703 Aug 12 06:59:00.894918 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 512/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:00 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:01.915806 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7041777c-53f2-46d0-ba31-a8670d0a6a2e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:01.916416 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7041777c-53f2-46d0-ba31-a8670d0a6a2e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:01.923338 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7041777c-53f2-46d0-ba31-a8670d0a6a2e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:01.923827 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7041777c-53f2-46d0-ba31-a8670d0a6a2e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:01.924261 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7041777c-53f2-46d0-ba31-a8670d0a6a2e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:01.924951 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7041777c-53f2-46d0-ba31-a8670d0a6a2e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:01.925408 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7041777c-53f2-46d0-ba31-a8670d0a6a2e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:01.925836 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7041777c-53f2-46d0-ba31-a8670d0a6a2e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:02.093666 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7041777c-53f2-46d0-ba31-a8670d0a6a2e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:02.101643 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7041777c-53f2-46d0-ba31-a8670d0a6a2e tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.189876 Aug 12 06:59:02.102188 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 545/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:01 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:03.127052 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cbff9a09-a9c2-4c8a-9ee9-02b55fae2d79 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:03.128027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cbff9a09-a9c2-4c8a-9ee9-02b55fae2d79 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:03.139130 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbff9a09-a9c2-4c8a-9ee9-02b55fae2d79 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:03.140307 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbff9a09-a9c2-4c8a-9ee9-02b55fae2d79 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:03.141033 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbff9a09-a9c2-4c8a-9ee9-02b55fae2d79 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:03.142174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbff9a09-a9c2-4c8a-9ee9-02b55fae2d79 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:03.143024 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbff9a09-a9c2-4c8a-9ee9-02b55fae2d79 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:03.143955 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cbff9a09-a9c2-4c8a-9ee9-02b55fae2d79 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:03.286587 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cbff9a09-a9c2-4c8a-9ee9-02b55fae2d79 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:03.294374 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cbff9a09-a9c2-4c8a-9ee9-02b55fae2d79 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.173903 Aug 12 06:59:03.295005 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 513/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:03 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:04.316808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9b0b65fb-9148-4bfa-850d-d1f41aa21ff1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:04.317412 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b0b65fb-9148-4bfa-850d-d1f41aa21ff1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:04.324283 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b0b65fb-9148-4bfa-850d-d1f41aa21ff1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:04.324772 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b0b65fb-9148-4bfa-850d-d1f41aa21ff1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:04.325218 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b0b65fb-9148-4bfa-850d-d1f41aa21ff1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:04.325909 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b0b65fb-9148-4bfa-850d-d1f41aa21ff1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:04.326367 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b0b65fb-9148-4bfa-850d-d1f41aa21ff1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:04.326793 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b0b65fb-9148-4bfa-850d-d1f41aa21ff1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:04.458934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b0b65fb-9148-4bfa-850d-d1f41aa21ff1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:04.466923 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9b0b65fb-9148-4bfa-850d-d1f41aa21ff1 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.154200 Aug 12 06:59:04.467560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 546/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:04 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:05.492494 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4b645af6-4003-454b-8d8f-7d32b34be928 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:05.493504 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4b645af6-4003-454b-8d8f-7d32b34be928 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:05.504457 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b645af6-4003-454b-8d8f-7d32b34be928 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:05.505348 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b645af6-4003-454b-8d8f-7d32b34be928 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:05.506067 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b645af6-4003-454b-8d8f-7d32b34be928 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:05.507228 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b645af6-4003-454b-8d8f-7d32b34be928 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:05.507984 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b645af6-4003-454b-8d8f-7d32b34be928 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:05.508680 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b645af6-4003-454b-8d8f-7d32b34be928 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:05.650362 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4b645af6-4003-454b-8d8f-7d32b34be928 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:05.658302 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4b645af6-4003-454b-8d8f-7d32b34be928 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1509 microversion: 2.1 time: 0.172364 Aug 12 06:59:05.658859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 514/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:05 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:05.678695 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2fc7b512-7cce-4ae7-bde5-9c590ffff18b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:59:05.679294 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2fc7b512-7cce-4ae7-bde5-9c590ffff18b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:05.686259 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fc7b512-7cce-4ae7-bde5-9c590ffff18b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:05.686804 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fc7b512-7cce-4ae7-bde5-9c590ffff18b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:05.687268 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fc7b512-7cce-4ae7-bde5-9c590ffff18b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:05.687952 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fc7b512-7cce-4ae7-bde5-9c590ffff18b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:05.688394 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fc7b512-7cce-4ae7-bde5-9c590ffff18b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:05.688898 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fc7b512-7cce-4ae7-bde5-9c590ffff18b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:05.717595 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2fc7b512-7cce-4ae7-bde5-9c590ffff18b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127088) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 06:59:05.785567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2fc7b512-7cce-4ae7-bde5-9c590ffff18b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "POST /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5/action" status: 202 len: 0 microversion: 2.1 time: 0.110659 Aug 12 06:59:05.786181 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 547/1061] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 06:59:05 2022] POST /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 06:59:05.794393 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-665701d6-ab05-4031-8a0b-3e230dddb9f4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:05.795024 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-665701d6-ab05-4031-8a0b-3e230dddb9f4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:05.801416 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-665701d6-ab05-4031-8a0b-3e230dddb9f4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:05.802027 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-665701d6-ab05-4031-8a0b-3e230dddb9f4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:05.802467 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-665701d6-ab05-4031-8a0b-3e230dddb9f4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:05.803161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-665701d6-ab05-4031-8a0b-3e230dddb9f4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:05.803666 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-665701d6-ab05-4031-8a0b-3e230dddb9f4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:05.804087 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-665701d6-ab05-4031-8a0b-3e230dddb9f4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:05.949336 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-665701d6-ab05-4031-8a0b-3e230dddb9f4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:05.961956 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-665701d6-ab05-4031-8a0b-3e230dddb9f4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1517 microversion: 2.1 time: 0.171198 Aug 12 06:59:05.962641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 515/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:05 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:06.983095 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ae69484c-41bf-4a7b-8faa-496de1db1b8f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:06.983781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ae69484c-41bf-4a7b-8faa-496de1db1b8f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:06.990251 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae69484c-41bf-4a7b-8faa-496de1db1b8f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:06.990724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae69484c-41bf-4a7b-8faa-496de1db1b8f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:06.991176 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae69484c-41bf-4a7b-8faa-496de1db1b8f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:06.991856 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae69484c-41bf-4a7b-8faa-496de1db1b8f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:06.992340 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae69484c-41bf-4a7b-8faa-496de1db1b8f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:06.992727 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae69484c-41bf-4a7b-8faa-496de1db1b8f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:07.124111 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ae69484c-41bf-4a7b-8faa-496de1db1b8f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:07.131796 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ae69484c-41bf-4a7b-8faa-496de1db1b8f tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1517 microversion: 2.1 time: 0.152651 Aug 12 06:59:07.132427 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 548/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:06 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:07.746571 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-98754be8-2c95-4732-9219-e09e14806437 req-ae68648b-75ac-4afa-90ed-457a1e03e2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397bc232-8dd0-4925-89b3-7f2cd5a06dd5", "name": "network-vif-unplugged", "status": "completed", "tag": "7022fc1a-cc3e-4c75-84ac-18933a74f704"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:59:07.757205 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-98754be8-2c95-4732-9219-e09e14806437 req-ae68648b-75ac-4afa-90ed-457a1e03e2b2 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:07.757841 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-98754be8-2c95-4732-9219-e09e14806437 req-ae68648b-75ac-4afa-90ed-457a1e03e2b2 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:07.759189 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-98754be8-2c95-4732-9219-e09e14806437 req-ae68648b-75ac-4afa-90ed-457a1e03e2b2 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:07.771431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.compute.server_external_events [req-98754be8-2c95-4732-9219-e09e14806437 req-ae68648b-75ac-4afa-90ed-457a1e03e2b2 service nova] Unable to find a host for instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5. Dropping event network-vif-unplugged {{(pid=127087) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 12 06:59:07.772231 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-98754be8-2c95-4732-9219-e09e14806437 req-ae68648b-75ac-4afa-90ed-457a1e03e2b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029751 Aug 12 06:59:07.773025 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 516/1064] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 12 06:59:08.152714 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e8c659bf-c797-4106-acaa-b04825bf35de tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:08.153318 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e8c659bf-c797-4106-acaa-b04825bf35de tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:08.159974 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8c659bf-c797-4106-acaa-b04825bf35de tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:08.160452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8c659bf-c797-4106-acaa-b04825bf35de tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:08.160885 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8c659bf-c797-4106-acaa-b04825bf35de tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:08.161560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8c659bf-c797-4106-acaa-b04825bf35de tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:08.162009 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8c659bf-c797-4106-acaa-b04825bf35de tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:08.162425 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8c659bf-c797-4106-acaa-b04825bf35de tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:08.303517 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e8c659bf-c797-4106-acaa-b04825bf35de tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:08.312883 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e8c659bf-c797-4106-acaa-b04825bf35de tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1517 microversion: 2.1 time: 0.164147 Aug 12 06:59:08.313448 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 549/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:08 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:09.342508 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6a274714-7c1e-49fe-977d-65a0cceed8c9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:09.343149 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6a274714-7c1e-49fe-977d-65a0cceed8c9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:09.350397 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a274714-7c1e-49fe-977d-65a0cceed8c9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:09.350872 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a274714-7c1e-49fe-977d-65a0cceed8c9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:09.351321 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a274714-7c1e-49fe-977d-65a0cceed8c9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:09.352014 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a274714-7c1e-49fe-977d-65a0cceed8c9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:09.352515 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a274714-7c1e-49fe-977d-65a0cceed8c9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:09.353063 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a274714-7c1e-49fe-977d-65a0cceed8c9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:09.486703 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6a274714-7c1e-49fe-977d-65a0cceed8c9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:09.494999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6a274714-7c1e-49fe-977d-65a0cceed8c9 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1517 microversion: 2.1 time: 0.156439 Aug 12 06:59:09.495579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 517/1066] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:09 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:10.516977 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-48dc4d0d-a492-4261-96d0-7011658376eb tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:10.517688 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-48dc4d0d-a492-4261-96d0-7011658376eb tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:10.524870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48dc4d0d-a492-4261-96d0-7011658376eb tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:10.525424 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48dc4d0d-a492-4261-96d0-7011658376eb tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:10.525915 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48dc4d0d-a492-4261-96d0-7011658376eb tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:10.526755 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48dc4d0d-a492-4261-96d0-7011658376eb tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:10.527298 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48dc4d0d-a492-4261-96d0-7011658376eb tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:10.527787 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48dc4d0d-a492-4261-96d0-7011658376eb tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:10.664163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-48dc4d0d-a492-4261-96d0-7011658376eb tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:10.672019 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-48dc4d0d-a492-4261-96d0-7011658376eb tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1519 microversion: 2.1 time: 0.159682 Aug 12 06:59:10.672583 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 550/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:10 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:11.692926 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-370af96b-7dcc-4781-8bd1-7552f03b8cd2 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:11.693559 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-370af96b-7dcc-4781-8bd1-7552f03b8cd2 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:11.700538 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-370af96b-7dcc-4781-8bd1-7552f03b8cd2 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:11.700990 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-370af96b-7dcc-4781-8bd1-7552f03b8cd2 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:11.701413 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-370af96b-7dcc-4781-8bd1-7552f03b8cd2 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:11.702100 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-370af96b-7dcc-4781-8bd1-7552f03b8cd2 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:11.702546 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-370af96b-7dcc-4781-8bd1-7552f03b8cd2 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:11.702958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-370af96b-7dcc-4781-8bd1-7552f03b8cd2 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:11.914581 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-370af96b-7dcc-4781-8bd1-7552f03b8cd2 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:11.922945 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-370af96b-7dcc-4781-8bd1-7552f03b8cd2 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.233712 Aug 12 06:59:11.924079 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 518/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:11 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:12.949139 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-df7b1fa2-ab0f-4fef-a0e1-11f2835d9841 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:12.950062 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-df7b1fa2-ab0f-4fef-a0e1-11f2835d9841 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:12.958196 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df7b1fa2-ab0f-4fef-a0e1-11f2835d9841 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:12.958701 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df7b1fa2-ab0f-4fef-a0e1-11f2835d9841 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:12.959194 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df7b1fa2-ab0f-4fef-a0e1-11f2835d9841 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:12.959919 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df7b1fa2-ab0f-4fef-a0e1-11f2835d9841 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:12.960394 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df7b1fa2-ab0f-4fef-a0e1-11f2835d9841 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:12.960830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df7b1fa2-ab0f-4fef-a0e1-11f2835d9841 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:13.094847 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-df7b1fa2-ab0f-4fef-a0e1-11f2835d9841 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:13.102780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-df7b1fa2-ab0f-4fef-a0e1-11f2835d9841 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.160535 Aug 12 06:59:13.103379 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 551/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:12 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:14.134094 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-008a6523-d90c-4eb3-9afd-840709471701 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:14.135201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-008a6523-d90c-4eb3-9afd-840709471701 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:14.144520 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-008a6523-d90c-4eb3-9afd-840709471701 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:14.144996 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-008a6523-d90c-4eb3-9afd-840709471701 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:14.145423 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-008a6523-d90c-4eb3-9afd-840709471701 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:14.146108 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-008a6523-d90c-4eb3-9afd-840709471701 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:14.146553 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-008a6523-d90c-4eb3-9afd-840709471701 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:14.146963 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-008a6523-d90c-4eb3-9afd-840709471701 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:14.284029 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-008a6523-d90c-4eb3-9afd-840709471701 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:14.295745 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-008a6523-d90c-4eb3-9afd-840709471701 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.167908 Aug 12 06:59:14.296491 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 519/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:14 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:15.332611 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-24fff405-f2c8-4a97-a639-ba599f024637 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:15.333226 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-24fff405-f2c8-4a97-a639-ba599f024637 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:15.340014 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fff405-f2c8-4a97-a639-ba599f024637 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:15.340505 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fff405-f2c8-4a97-a639-ba599f024637 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:15.340930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fff405-f2c8-4a97-a639-ba599f024637 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:15.341621 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fff405-f2c8-4a97-a639-ba599f024637 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:15.342070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fff405-f2c8-4a97-a639-ba599f024637 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:15.342492 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24fff405-f2c8-4a97-a639-ba599f024637 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:15.489177 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-24fff405-f2c8-4a97-a639-ba599f024637 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:15.499642 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-24fff405-f2c8-4a97-a639-ba599f024637 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.171403 Aug 12 06:59:15.500251 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 552/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:15 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:16.529161 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-26b4a6ef-8e30-422f-a7c2-6c2d1305d3ed tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:16.530266 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-26b4a6ef-8e30-422f-a7c2-6c2d1305d3ed tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:16.538030 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b4a6ef-8e30-422f-a7c2-6c2d1305d3ed tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:16.538510 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b4a6ef-8e30-422f-a7c2-6c2d1305d3ed tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:16.538930 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b4a6ef-8e30-422f-a7c2-6c2d1305d3ed tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:16.539644 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b4a6ef-8e30-422f-a7c2-6c2d1305d3ed tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:16.540088 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b4a6ef-8e30-422f-a7c2-6c2d1305d3ed tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:16.540524 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b4a6ef-8e30-422f-a7c2-6c2d1305d3ed tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:16.672822 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-26b4a6ef-8e30-422f-a7c2-6c2d1305d3ed tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:16.680714 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-26b4a6ef-8e30-422f-a7c2-6c2d1305d3ed tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.158187 Aug 12 06:59:16.681286 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 520/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:16 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:17.705931 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2e0dc075-abb8-4255-9577-b45b905c13ab tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:17.706637 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2e0dc075-abb8-4255-9577-b45b905c13ab tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:17.715005 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e0dc075-abb8-4255-9577-b45b905c13ab tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:17.715693 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e0dc075-abb8-4255-9577-b45b905c13ab tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:17.716219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e0dc075-abb8-4255-9577-b45b905c13ab tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:17.717063 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e0dc075-abb8-4255-9577-b45b905c13ab tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:17.717617 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e0dc075-abb8-4255-9577-b45b905c13ab tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:17.718129 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e0dc075-abb8-4255-9577-b45b905c13ab tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:17.740304 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:59:17.854513 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2e0dc075-abb8-4255-9577-b45b905c13ab tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:17.862580 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2e0dc075-abb8-4255-9577-b45b905c13ab tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.163209 Aug 12 06:59:17.863188 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 553/1073] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:17 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:18.888503 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ae94341f-2216-4139-9b15-8d26aefa6a8b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:18.889698 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ae94341f-2216-4139-9b15-8d26aefa6a8b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:18.900127 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae94341f-2216-4139-9b15-8d26aefa6a8b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:18.900914 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae94341f-2216-4139-9b15-8d26aefa6a8b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:18.901623 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae94341f-2216-4139-9b15-8d26aefa6a8b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:18.902741 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae94341f-2216-4139-9b15-8d26aefa6a8b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:18.903621 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae94341f-2216-4139-9b15-8d26aefa6a8b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:18.904315 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae94341f-2216-4139-9b15-8d26aefa6a8b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:19.050365 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ae94341f-2216-4139-9b15-8d26aefa6a8b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:19.058328 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ae94341f-2216-4139-9b15-8d26aefa6a8b tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.176450 Aug 12 06:59:19.058890 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 521/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:18 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:20.083886 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a3fc7322-53be-4c89-b657-a07f3b528942 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:20.084808 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a3fc7322-53be-4c89-b657-a07f3b528942 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:20.095777 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a3fc7322-53be-4c89-b657-a07f3b528942 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:20.096577 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a3fc7322-53be-4c89-b657-a07f3b528942 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:20.097333 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a3fc7322-53be-4c89-b657-a07f3b528942 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:20.098493 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a3fc7322-53be-4c89-b657-a07f3b528942 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:20.099323 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a3fc7322-53be-4c89-b657-a07f3b528942 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:20.100021 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a3fc7322-53be-4c89-b657-a07f3b528942 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:20.238087 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a3fc7322-53be-4c89-b657-a07f3b528942 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:20.249625 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a3fc7322-53be-4c89-b657-a07f3b528942 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.172135 Aug 12 06:59:20.250398 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 554/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:20 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:21.276560 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-92a41f34-14f3-47ae-8db5-d04da002dcea tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:21.277235 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-92a41f34-14f3-47ae-8db5-d04da002dcea tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:21.279917 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=28 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:59:21.286169 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92a41f34-14f3-47ae-8db5-d04da002dcea tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:21.286724 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92a41f34-14f3-47ae-8db5-d04da002dcea tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:21.287255 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92a41f34-14f3-47ae-8db5-d04da002dcea tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:21.288057 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92a41f34-14f3-47ae-8db5-d04da002dcea tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:21.288579 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92a41f34-14f3-47ae-8db5-d04da002dcea tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:21.289060 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-92a41f34-14f3-47ae-8db5-d04da002dcea tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:21.292233 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=80 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:59:21.427299 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-92a41f34-14f3-47ae-8db5-d04da002dcea tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:21.435465 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-92a41f34-14f3-47ae-8db5-d04da002dcea tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.164199 Aug 12 06:59:21.436022 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 522/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:21 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:22.467919 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9a01c48a-cec4-4380-850f-c61f5cec598d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:22.468855 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9a01c48a-cec4-4380-850f-c61f5cec598d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:22.472628 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 06:59:22.479971 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a01c48a-cec4-4380-850f-c61f5cec598d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:22.480597 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a01c48a-cec4-4380-850f-c61f5cec598d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:22.481047 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a01c48a-cec4-4380-850f-c61f5cec598d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:22.481761 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a01c48a-cec4-4380-850f-c61f5cec598d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:22.482205 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a01c48a-cec4-4380-850f-c61f5cec598d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:22.482613 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a01c48a-cec4-4380-850f-c61f5cec598d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:22.620949 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9a01c48a-cec4-4380-850f-c61f5cec598d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:22.628590 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9a01c48a-cec4-4380-850f-c61f5cec598d tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.167185 Aug 12 06:59:22.629124 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 555/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:22 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:23.653468 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-03c06b2e-2a15-4260-88e1-0071df34b970 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:23.654286 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-03c06b2e-2a15-4260-88e1-0071df34b970 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:23.663224 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03c06b2e-2a15-4260-88e1-0071df34b970 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:23.663857 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03c06b2e-2a15-4260-88e1-0071df34b970 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:23.664419 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03c06b2e-2a15-4260-88e1-0071df34b970 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:23.665350 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03c06b2e-2a15-4260-88e1-0071df34b970 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:23.665949 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03c06b2e-2a15-4260-88e1-0071df34b970 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:23.666467 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-03c06b2e-2a15-4260-88e1-0071df34b970 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:23.803147 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-03c06b2e-2a15-4260-88e1-0071df34b970 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:23.811234 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-03c06b2e-2a15-4260-88e1-0071df34b970 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.163569 Aug 12 06:59:23.811818 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 523/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:23 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:23.842779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-f85b9f9c-dfcc-4efa-96a9-bb06efaa9d10 req-ecaa3f31-e441-4405-8c27-72fec0444938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397bc232-8dd0-4925-89b3-7f2cd5a06dd5", "name": "network-vif-plugged", "status": "completed", "tag": "7022fc1a-cc3e-4c75-84ac-18933a74f704"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 06:59:23.853415 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f85b9f9c-dfcc-4efa-96a9-bb06efaa9d10 req-ecaa3f31-e441-4405-8c27-72fec0444938 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:23.854007 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f85b9f9c-dfcc-4efa-96a9-bb06efaa9d10 req-ecaa3f31-e441-4405-8c27-72fec0444938 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:23.854437 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f85b9f9c-dfcc-4efa-96a9-bb06efaa9d10 req-ecaa3f31-e441-4405-8c27-72fec0444938 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:23.865992 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-f85b9f9c-dfcc-4efa-96a9-bb06efaa9d10 req-ecaa3f31-e441-4405-8c27-72fec0444938 service nova] Creating event network-vif-plugged:7022fc1a-cc3e-4c75-84ac-18933a74f704 for instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 on hv-cinder-84457 Aug 12 06:59:23.871273 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-f85b9f9c-dfcc-4efa-96a9-bb06efaa9d10 req-ecaa3f31-e441-4405-8c27-72fec0444938 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032685 Aug 12 06:59:23.871851 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 556/1079] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 06:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 06:59:24.837098 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6a0b921f-f803-4a7d-a89d-d3aa548e76d4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:24.837964 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6a0b921f-f803-4a7d-a89d-d3aa548e76d4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:24.845354 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a0b921f-f803-4a7d-a89d-d3aa548e76d4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:24.845834 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a0b921f-f803-4a7d-a89d-d3aa548e76d4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:24.846262 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a0b921f-f803-4a7d-a89d-d3aa548e76d4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:24.846949 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a0b921f-f803-4a7d-a89d-d3aa548e76d4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:24.847431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a0b921f-f803-4a7d-a89d-d3aa548e76d4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:24.847859 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a0b921f-f803-4a7d-a89d-d3aa548e76d4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:24.997860 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6a0b921f-f803-4a7d-a89d-d3aa548e76d4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:25.006147 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6a0b921f-f803-4a7d-a89d-d3aa548e76d4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1575 microversion: 2.1 time: 0.175961 Aug 12 06:59:25.006718 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 524/1080] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:24 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:26.033016 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4d6bfb37-e575-4e8b-8f84-8e743da9dd42 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 06:59:26.034167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4d6bfb37-e575-4e8b-8f84-8e743da9dd42 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 06:59:26.044071 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d6bfb37-e575-4e8b-8f84-8e743da9dd42 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:26.044553 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d6bfb37-e575-4e8b-8f84-8e743da9dd42 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:26.044985 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d6bfb37-e575-4e8b-8f84-8e743da9dd42 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:26.045670 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d6bfb37-e575-4e8b-8f84-8e743da9dd42 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 06:59:26.046120 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d6bfb37-e575-4e8b-8f84-8e743da9dd42 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 06:59:26.046534 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d6bfb37-e575-4e8b-8f84-8e743da9dd42 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 06:59:26.187776 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4d6bfb37-e575-4e8b-8f84-8e743da9dd42 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 06:59:26.195677 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4d6bfb37-e575-4e8b-8f84-8e743da9dd42 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1562 microversion: 2.1 time: 0.170573 Aug 12 06:59:26.196199 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 557/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 06:59:26 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 06:59:36.080544 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 06:59:36.081495 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Fri Aug 12 06:59:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 07:00:16.033837 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-82017068", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-271553105", "security_groups": [{"name": "tempest-secgroup-smoke-2135118312"}], "block_device_mapping_v2": [{"uuid": "c31ad3a8-dc55-4c01-be70-51f037a47f04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8101570f-07e2-43c5-a2c5-9493f86335a2"}]}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 07:00:16.043901 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=5 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 07:00:16.044547 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=17 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 07:00:16.154211 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] validate_networks() for [('8101570f-07e2-43c5-a2c5-9493f86335a2', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 07:00:16.585949 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 07:00:16.586602 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 07:00:16.587250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 07:00:16.587897 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 07:00:16.588457 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 07:00:16.597661 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:16.598137 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:16.598570 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:16.599329 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:16.599788 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:16.600202 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:16.616980 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Getting quotas for project 64466d34729c44908afad2679c99d439. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 07:00:16.621256 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Getting quotas for user 5138389f1535438d8380cf6cc9bd891b and project 64466d34729c44908afad2679c99d439. Resources: {'cores', 'ram', 'instances'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 07:00:16.678703 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 07:00:16.680818 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c31ad3a8-dc55-4c01-be70-51f037a47f04',volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 07:00:16.817888 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6180a336-89bd-42af-9b62-9c0d3c10c3b4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787852 Aug 12 07:00:16.818516 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 525/1082] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 07:00:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 07:00:16.829754 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-60fe2831-1895-4cef-be25-4fe818d48ed4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:16.830393 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-60fe2831-1895-4cef-be25-4fe818d48ed4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:16.832888 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=5 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 07:00:16.833518 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=22 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 07:00:16.886790 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-60fe2831-1895-4cef-be25-4fe818d48ed4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:16.896413 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-60fe2831-1895-4cef-be25-4fe818d48ed4 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1092 microversion: 2.1 time: 0.070689 Aug 12 07:00:16.896991 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 558/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:16 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1092 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 07:00:17.917443 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1206e1da-971b-4c31-baf1-2bee68ed0ff9 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:17.918064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1206e1da-971b-4c31-baf1-2bee68ed0ff9 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:17.924986 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1206e1da-971b-4c31-baf1-2bee68ed0ff9 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:17.925477 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1206e1da-971b-4c31-baf1-2bee68ed0ff9 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:17.925903 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1206e1da-971b-4c31-baf1-2bee68ed0ff9 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:17.926595 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1206e1da-971b-4c31-baf1-2bee68ed0ff9 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:17.927051 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1206e1da-971b-4c31-baf1-2bee68ed0ff9 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:17.927470 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1206e1da-971b-4c31-baf1-2bee68ed0ff9 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:17.999919 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1206e1da-971b-4c31-baf1-2bee68ed0ff9 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:18.007702 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1206e1da-971b-4c31-baf1-2bee68ed0ff9 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1208 microversion: 2.1 time: 0.094180 Aug 12 07:00:18.008525 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 526/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:17 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1208 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:19.029685 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-852e8051-c391-4370-9d77-09e4d286cf86 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:19.030292 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-852e8051-c391-4370-9d77-09e4d286cf86 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:19.036959 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-852e8051-c391-4370-9d77-09e4d286cf86 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:19.037443 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-852e8051-c391-4370-9d77-09e4d286cf86 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:19.037870 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-852e8051-c391-4370-9d77-09e4d286cf86 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:19.038567 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-852e8051-c391-4370-9d77-09e4d286cf86 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:19.039097 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-852e8051-c391-4370-9d77-09e4d286cf86 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:19.039560 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-852e8051-c391-4370-9d77-09e4d286cf86 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:19.247812 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-852e8051-c391-4370-9d77-09e4d286cf86 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:19.256738 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-852e8051-c391-4370-9d77-09e4d286cf86 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1264 microversion: 2.1 time: 0.231063 Aug 12 07:00:19.257571 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 559/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:19 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:19.340703 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-dbb7a65a-b50d-4577-88e0-0d4b446f2bd3 req-17f11a1b-99c3-4b86-b502-0019cde4aea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a55f44-2ecd-4150-899b-3dfa1b973e30", "tag": "0631d29c-428e-4013-8268-2037d9e76cef"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 07:00:19.351868 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-dbb7a65a-b50d-4577-88e0-0d4b446f2bd3 req-17f11a1b-99c3-4b86-b502-0019cde4aea6 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:19.352586 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-dbb7a65a-b50d-4577-88e0-0d4b446f2bd3 req-17f11a1b-99c3-4b86-b502-0019cde4aea6 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:19.353283 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-dbb7a65a-b50d-4577-88e0-0d4b446f2bd3 req-17f11a1b-99c3-4b86-b502-0019cde4aea6 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:19.364899 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-dbb7a65a-b50d-4577-88e0-0d4b446f2bd3 req-17f11a1b-99c3-4b86-b502-0019cde4aea6 service nova] Creating event network-changed:0631d29c-428e-4013-8268-2037d9e76cef for instance 86a55f44-2ecd-4150-899b-3dfa1b973e30 on hv-cinder-84457 Aug 12 07:00:19.369947 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-dbb7a65a-b50d-4577-88e0-0d4b446f2bd3 req-17f11a1b-99c3-4b86-b502-0019cde4aea6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032991 Aug 12 07:00:19.370546 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 527/1086] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 07:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 07:00:20.279844 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8e78f44d-e7c3-4378-9e1d-48aa39f03103 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:20.280405 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8e78f44d-e7c3-4378-9e1d-48aa39f03103 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:20.287618 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e78f44d-e7c3-4378-9e1d-48aa39f03103 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:20.288070 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e78f44d-e7c3-4378-9e1d-48aa39f03103 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:20.288526 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e78f44d-e7c3-4378-9e1d-48aa39f03103 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:20.289219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e78f44d-e7c3-4378-9e1d-48aa39f03103 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:20.289668 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e78f44d-e7c3-4378-9e1d-48aa39f03103 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:20.290089 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e78f44d-e7c3-4378-9e1d-48aa39f03103 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:20.491501 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8e78f44d-e7c3-4378-9e1d-48aa39f03103 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:20.499733 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8e78f44d-e7c3-4378-9e1d-48aa39f03103 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1264 microversion: 2.1 time: 0.223821 Aug 12 07:00:20.511511 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 560/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:20 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:21.522325 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a8909a8f-b85d-40c1-9374-9a54724da479 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:21.523089 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a8909a8f-b85d-40c1-9374-9a54724da479 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:21.530216 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8909a8f-b85d-40c1-9374-9a54724da479 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:21.530716 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8909a8f-b85d-40c1-9374-9a54724da479 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:21.531198 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8909a8f-b85d-40c1-9374-9a54724da479 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:21.531913 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8909a8f-b85d-40c1-9374-9a54724da479 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:21.532380 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8909a8f-b85d-40c1-9374-9a54724da479 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:21.532821 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8909a8f-b85d-40c1-9374-9a54724da479 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:21.689767 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a8909a8f-b85d-40c1-9374-9a54724da479 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:21.697492 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a8909a8f-b85d-40c1-9374-9a54724da479 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1264 microversion: 2.1 time: 0.180125 Aug 12 07:00:21.698065 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 528/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:21 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:22.723843 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-982bbe7b-0dfa-47c6-90ff-97636e5bbd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:22.724760 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-982bbe7b-0dfa-47c6-90ff-97636e5bbd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:22.735775 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-982bbe7b-0dfa-47c6-90ff-97636e5bbd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:22.736559 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-982bbe7b-0dfa-47c6-90ff-97636e5bbd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:22.737262 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-982bbe7b-0dfa-47c6-90ff-97636e5bbd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:22.738394 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-982bbe7b-0dfa-47c6-90ff-97636e5bbd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:22.739198 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-982bbe7b-0dfa-47c6-90ff-97636e5bbd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:22.739888 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-982bbe7b-0dfa-47c6-90ff-97636e5bbd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:22.886219 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-982bbe7b-0dfa-47c6-90ff-97636e5bbd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:22.896328 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-982bbe7b-0dfa-47c6-90ff-97636e5bbd79 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1264 microversion: 2.1 time: 0.179402 Aug 12 07:00:22.897026 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 561/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:22 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:23.929995 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-51ea8778-6a75-48e6-aad1-e04047bfa94a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:23.930817 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-51ea8778-6a75-48e6-aad1-e04047bfa94a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:23.941576 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-51ea8778-6a75-48e6-aad1-e04047bfa94a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:23.942382 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-51ea8778-6a75-48e6-aad1-e04047bfa94a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:23.943168 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-51ea8778-6a75-48e6-aad1-e04047bfa94a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:23.944310 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-51ea8778-6a75-48e6-aad1-e04047bfa94a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:23.945066 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-51ea8778-6a75-48e6-aad1-e04047bfa94a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:23.945783 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-51ea8778-6a75-48e6-aad1-e04047bfa94a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:24.085305 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-51ea8778-6a75-48e6-aad1-e04047bfa94a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:24.095658 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-51ea8778-6a75-48e6-aad1-e04047bfa94a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1264 microversion: 2.1 time: 0.172417 Aug 12 07:00:24.096260 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 529/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:23 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:25.126533 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3e850451-7ea0-4b76-8d1e-7dd68806c8b0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:25.127374 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3e850451-7ea0-4b76-8d1e-7dd68806c8b0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:25.137368 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e850451-7ea0-4b76-8d1e-7dd68806c8b0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:25.138158 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e850451-7ea0-4b76-8d1e-7dd68806c8b0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:25.138865 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e850451-7ea0-4b76-8d1e-7dd68806c8b0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:25.140338 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e850451-7ea0-4b76-8d1e-7dd68806c8b0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:25.140783 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e850451-7ea0-4b76-8d1e-7dd68806c8b0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:25.141192 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e850451-7ea0-4b76-8d1e-7dd68806c8b0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:25.277741 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3e850451-7ea0-4b76-8d1e-7dd68806c8b0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:25.289429 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3e850451-7ea0-4b76-8d1e-7dd68806c8b0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1264 microversion: 2.1 time: 0.169441 Aug 12 07:00:25.290289 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 562/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:25 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:26.314431 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-87061357-2d12-4648-ac1b-a7d98715ff7e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:26.315124 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-87061357-2d12-4648-ac1b-a7d98715ff7e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:26.321333 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87061357-2d12-4648-ac1b-a7d98715ff7e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:26.321810 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87061357-2d12-4648-ac1b-a7d98715ff7e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:26.322237 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87061357-2d12-4648-ac1b-a7d98715ff7e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:26.322924 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87061357-2d12-4648-ac1b-a7d98715ff7e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:26.323481 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87061357-2d12-4648-ac1b-a7d98715ff7e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:26.323896 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-87061357-2d12-4648-ac1b-a7d98715ff7e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:26.469141 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-87061357-2d12-4648-ac1b-a7d98715ff7e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:26.476678 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-87061357-2d12-4648-ac1b-a7d98715ff7e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1264 microversion: 2.1 time: 0.167500 Aug 12 07:00:26.477242 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 530/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:26 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:27.502067 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-33c4bd47-a358-4946-a904-fa61bd14fc38 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:27.503045 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-33c4bd47-a358-4946-a904-fa61bd14fc38 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:27.507031 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 07:00:27.516110 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33c4bd47-a358-4946-a904-fa61bd14fc38 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:27.516839 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33c4bd47-a358-4946-a904-fa61bd14fc38 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:27.517273 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33c4bd47-a358-4946-a904-fa61bd14fc38 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:27.518352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33c4bd47-a358-4946-a904-fa61bd14fc38 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:27.518352 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33c4bd47-a358-4946-a904-fa61bd14fc38 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:27.518796 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33c4bd47-a358-4946-a904-fa61bd14fc38 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:27.666200 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-33c4bd47-a358-4946-a904-fa61bd14fc38 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:27.673948 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-33c4bd47-a358-4946-a904-fa61bd14fc38 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1264 microversion: 2.1 time: 0.178537 Aug 12 07:00:27.674563 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 563/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:27 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:28.695777 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-63f72f54-2b3c-409e-bfa0-3db30c22bcb3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:28.696351 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-63f72f54-2b3c-409e-bfa0-3db30c22bcb3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:28.698337 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 07:00:28.699008 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 07:00:28.705077 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63f72f54-2b3c-409e-bfa0-3db30c22bcb3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:28.705551 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63f72f54-2b3c-409e-bfa0-3db30c22bcb3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:28.705973 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63f72f54-2b3c-409e-bfa0-3db30c22bcb3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:28.706648 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63f72f54-2b3c-409e-bfa0-3db30c22bcb3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:28.707127 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63f72f54-2b3c-409e-bfa0-3db30c22bcb3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:28.707540 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-63f72f54-2b3c-409e-bfa0-3db30c22bcb3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:28.842906 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-63f72f54-2b3c-409e-bfa0-3db30c22bcb3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:28.850757 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-63f72f54-2b3c-409e-bfa0-3db30c22bcb3 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1264 microversion: 2.1 time: 0.158899 Aug 12 07:00:28.851326 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 531/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:28 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:29.875102 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3742553e-8fee-4dd2-bb0d-6a41c2b66e5d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:29.875930 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3742553e-8fee-4dd2-bb0d-6a41c2b66e5d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:29.886943 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3742553e-8fee-4dd2-bb0d-6a41c2b66e5d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:29.887867 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3742553e-8fee-4dd2-bb0d-6a41c2b66e5d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:29.888551 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3742553e-8fee-4dd2-bb0d-6a41c2b66e5d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:29.890018 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3742553e-8fee-4dd2-bb0d-6a41c2b66e5d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:29.890903 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3742553e-8fee-4dd2-bb0d-6a41c2b66e5d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:29.891353 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3742553e-8fee-4dd2-bb0d-6a41c2b66e5d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:30.025241 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3742553e-8fee-4dd2-bb0d-6a41c2b66e5d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:30.032986 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3742553e-8fee-4dd2-bb0d-6a41c2b66e5d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1264 microversion: 2.1 time: 0.164460 Aug 12 07:00:30.033548 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 564/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:29 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:30.068958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-4254c558-9e78-40b2-ba07-c345af7621ab req-747774be-3d65-4868-aeb2-26f5202dcbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a55f44-2ecd-4150-899b-3dfa1b973e30", "name": "network-vif-plugged", "status": "completed", "tag": "0631d29c-428e-4013-8268-2037d9e76cef"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 07:00:30.079168 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4254c558-9e78-40b2-ba07-c345af7621ab req-747774be-3d65-4868-aeb2-26f5202dcbd7 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:30.079641 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4254c558-9e78-40b2-ba07-c345af7621ab req-747774be-3d65-4868-aeb2-26f5202dcbd7 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:30.080067 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4254c558-9e78-40b2-ba07-c345af7621ab req-747774be-3d65-4868-aeb2-26f5202dcbd7 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:30.092326 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-4254c558-9e78-40b2-ba07-c345af7621ab req-747774be-3d65-4868-aeb2-26f5202dcbd7 service nova] Creating event network-vif-plugged:0631d29c-428e-4013-8268-2037d9e76cef for instance 86a55f44-2ecd-4150-899b-3dfa1b973e30 on hv-cinder-84457 Aug 12 07:00:30.097476 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-4254c558-9e78-40b2-ba07-c345af7621ab req-747774be-3d65-4868-aeb2-26f5202dcbd7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032302 Aug 12 07:00:30.098102 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 532/1096] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 07:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 07:00:31.057802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-54853fdd-ea6e-4b89-b82f-c40d8309f602 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:31.058813 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-54853fdd-ea6e-4b89-b82f-c40d8309f602 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:31.067112 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54853fdd-ea6e-4b89-b82f-c40d8309f602 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:31.067600 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54853fdd-ea6e-4b89-b82f-c40d8309f602 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:31.068035 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54853fdd-ea6e-4b89-b82f-c40d8309f602 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:31.068732 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54853fdd-ea6e-4b89-b82f-c40d8309f602 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:31.069183 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54853fdd-ea6e-4b89-b82f-c40d8309f602 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:31.069598 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54853fdd-ea6e-4b89-b82f-c40d8309f602 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:31.212262 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-54853fdd-ea6e-4b89-b82f-c40d8309f602 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:31.220343 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-54853fdd-ea6e-4b89-b82f-c40d8309f602 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1264 microversion: 2.1 time: 0.169294 Aug 12 07:00:31.220940 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 565/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:31 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:32.246846 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-58a696c7-5372-481b-91c1-2a883698816e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:32.248064 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-58a696c7-5372-481b-91c1-2a883698816e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:32.255674 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58a696c7-5372-481b-91c1-2a883698816e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:32.256152 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58a696c7-5372-481b-91c1-2a883698816e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:32.256590 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58a696c7-5372-481b-91c1-2a883698816e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:32.257295 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58a696c7-5372-481b-91c1-2a883698816e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:32.257750 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58a696c7-5372-481b-91c1-2a883698816e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:32.258171 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58a696c7-5372-481b-91c1-2a883698816e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:32.403808 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-58a696c7-5372-481b-91c1-2a883698816e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:32.411800 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-58a696c7-5372-481b-91c1-2a883698816e tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1451 microversion: 2.1 time: 0.172905 Aug 12 07:00:32.412375 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 533/1098] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:32 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:32.431734 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3b98b04f-0649-4606-851a-e197ebe07d84 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:32.432331 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3b98b04f-0649-4606-851a-e197ebe07d84 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:32.438947 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b98b04f-0649-4606-851a-e197ebe07d84 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:32.439473 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b98b04f-0649-4606-851a-e197ebe07d84 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:32.439885 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b98b04f-0649-4606-851a-e197ebe07d84 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:32.440561 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b98b04f-0649-4606-851a-e197ebe07d84 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:32.441008 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b98b04f-0649-4606-851a-e197ebe07d84 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:32.441441 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b98b04f-0649-4606-851a-e197ebe07d84 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:32.595673 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3b98b04f-0649-4606-851a-e197ebe07d84 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:32.603171 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3b98b04f-0649-4606-851a-e197ebe07d84 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1451 microversion: 2.1 time: 0.175287 Aug 12 07:00:32.603739 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 566/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:32 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:34.520020 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-faa0f117-6ed4-420d-872a-51f023266c62 req-7d4a6dbe-d0ab-4323-af5d-592004ba4bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a55f44-2ecd-4150-899b-3dfa1b973e30", "tag": "0631d29c-428e-4013-8268-2037d9e76cef"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 07:00:34.530230 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-faa0f117-6ed4-420d-872a-51f023266c62 req-7d4a6dbe-d0ab-4323-af5d-592004ba4bee service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:34.530783 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-faa0f117-6ed4-420d-872a-51f023266c62 req-7d4a6dbe-d0ab-4323-af5d-592004ba4bee service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:34.531656 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-faa0f117-6ed4-420d-872a-51f023266c62 req-7d4a6dbe-d0ab-4323-af5d-592004ba4bee service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:34.542635 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-faa0f117-6ed4-420d-872a-51f023266c62 req-7d4a6dbe-d0ab-4323-af5d-592004ba4bee service nova] Creating event network-changed:0631d29c-428e-4013-8268-2037d9e76cef for instance 86a55f44-2ecd-4150-899b-3dfa1b973e30 on hv-cinder-84457 Aug 12 07:00:34.547694 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-faa0f117-6ed4-420d-872a-51f023266c62 req-7d4a6dbe-d0ab-4323-af5d-592004ba4bee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031585 Aug 12 07:00:34.548368 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 534/1100] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 07:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 07:00:40.355892 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-72e90960-2d8c-4556-8f09-b1c0663b0901 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:40.356450 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-72e90960-2d8c-4556-8f09-b1c0663b0901 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:40.363741 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72e90960-2d8c-4556-8f09-b1c0663b0901 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:40.364221 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72e90960-2d8c-4556-8f09-b1c0663b0901 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:40.364648 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72e90960-2d8c-4556-8f09-b1c0663b0901 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:40.365333 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72e90960-2d8c-4556-8f09-b1c0663b0901 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:40.365781 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72e90960-2d8c-4556-8f09-b1c0663b0901 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:40.366196 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72e90960-2d8c-4556-8f09-b1c0663b0901 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:40.392707 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-72e90960-2d8c-4556-8f09-b1c0663b0901 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 07:00:40.418818 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-e754c920-a03f-414b-be76-5d974efd9b99 req-1fdd7269-b7ef-4e2c-b0da-ad43714730bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397bc232-8dd0-4925-89b3-7f2cd5a06dd5", "tag": "7022fc1a-cc3e-4c75-84ac-18933a74f704"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 07:00:40.428765 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e754c920-a03f-414b-be76-5d974efd9b99 req-1fdd7269-b7ef-4e2c-b0da-ad43714730bf service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:40.429212 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e754c920-a03f-414b-be76-5d974efd9b99 req-1fdd7269-b7ef-4e2c-b0da-ad43714730bf service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:40.429671 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e754c920-a03f-414b-be76-5d974efd9b99 req-1fdd7269-b7ef-4e2c-b0da-ad43714730bf service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:40.441929 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-e754c920-a03f-414b-be76-5d974efd9b99 req-1fdd7269-b7ef-4e2c-b0da-ad43714730bf service nova] Creating event network-changed:7022fc1a-cc3e-4c75-84ac-18933a74f704 for instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 on hv-cinder-84457 Aug 12 07:00:40.448410 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-e754c920-a03f-414b-be76-5d974efd9b99 req-1fdd7269-b7ef-4e2c-b0da-ad43714730bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093557 Aug 12 07:00:40.449250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 535/1101] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 07:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 07:00:40.469967 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-72e90960-2d8c-4556-8f09-b1c0663b0901 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "DELETE /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 204 len: 0 microversion: 2.1 time: 0.117785 Aug 12 07:00:40.470574 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 567/1102] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 07:00:40 2022] DELETE /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 07:00:40.479331 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-89185649-1c44-4c85-b7a7-a3876aa4f218 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:40.480051 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-89185649-1c44-4c85-b7a7-a3876aa4f218 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:40.486390 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89185649-1c44-4c85-b7a7-a3876aa4f218 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:40.486904 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89185649-1c44-4c85-b7a7-a3876aa4f218 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:40.487684 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89185649-1c44-4c85-b7a7-a3876aa4f218 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:40.488327 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89185649-1c44-4c85-b7a7-a3876aa4f218 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:40.488979 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89185649-1c44-4c85-b7a7-a3876aa4f218 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:40.489430 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89185649-1c44-4c85-b7a7-a3876aa4f218 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:40.656803 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-89185649-1c44-4c85-b7a7-a3876aa4f218 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:40.664834 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-89185649-1c44-4c85-b7a7-a3876aa4f218 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.189702 Aug 12 07:00:40.665468 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 536/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:40 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:41.690998 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3ce4080d-051f-4aae-8d82-9706ba43a96c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:41.692356 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3ce4080d-051f-4aae-8d82-9706ba43a96c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:41.703387 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ce4080d-051f-4aae-8d82-9706ba43a96c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:41.704174 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ce4080d-051f-4aae-8d82-9706ba43a96c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:41.704880 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ce4080d-051f-4aae-8d82-9706ba43a96c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:41.705947 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ce4080d-051f-4aae-8d82-9706ba43a96c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:41.706396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ce4080d-051f-4aae-8d82-9706ba43a96c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:41.706842 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ce4080d-051f-4aae-8d82-9706ba43a96c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:41.877883 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3ce4080d-051f-4aae-8d82-9706ba43a96c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:41.885779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3ce4080d-051f-4aae-8d82-9706ba43a96c tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1568 microversion: 2.1 time: 0.201944 Aug 12 07:00:41.886365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 568/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:41 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:42.769065 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-2221f917-48dc-4e58-93ea-1e5f867dcf6b req-b662aff1-c308-45d1-a4d8-81afe967a8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397bc232-8dd0-4925-89b3-7f2cd5a06dd5", "name": "network-vif-deleted", "tag": "7022fc1a-cc3e-4c75-84ac-18933a74f704"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 07:00:42.779261 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-2221f917-48dc-4e58-93ea-1e5f867dcf6b req-b662aff1-c308-45d1-a4d8-81afe967a8ee service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:42.779736 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-2221f917-48dc-4e58-93ea-1e5f867dcf6b req-b662aff1-c308-45d1-a4d8-81afe967a8ee service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:42.780159 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-2221f917-48dc-4e58-93ea-1e5f867dcf6b req-b662aff1-c308-45d1-a4d8-81afe967a8ee service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:42.792842 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-2221f917-48dc-4e58-93ea-1e5f867dcf6b req-b662aff1-c308-45d1-a4d8-81afe967a8ee service nova] Creating event network-vif-deleted:7022fc1a-cc3e-4c75-84ac-18933a74f704 for instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 on hv-cinder-84457 Aug 12 07:00:42.798328 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-2221f917-48dc-4e58-93ea-1e5f867dcf6b req-b662aff1-c308-45d1-a4d8-81afe967a8ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 Aug 12 07:00:42.799381 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 537/1105] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 07:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 07:00:42.907658 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-92ac749e-dfe0-4cfc-a080-e227def7b4c4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:42.908396 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-92ac749e-dfe0-4cfc-a080-e227def7b4c4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:42.915603 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ac749e-dfe0-4cfc-a080-e227def7b4c4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:42.916084 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ac749e-dfe0-4cfc-a080-e227def7b4c4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:42.916514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ac749e-dfe0-4cfc-a080-e227def7b4c4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:42.917215 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ac749e-dfe0-4cfc-a080-e227def7b4c4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:42.917658 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ac749e-dfe0-4cfc-a080-e227def7b4c4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:42.918084 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ac749e-dfe0-4cfc-a080-e227def7b4c4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:42.980153 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92ac749e-dfe0-4cfc-a080-e227def7b4c4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7450a2c6c0364245a9e609577e82859d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8139d6fef5384619a46f4b7f2095a565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:00:42.987948 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-92ac749e-dfe0-4cfc-a080-e227def7b4c4 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 200 len: 1218 microversion: 2.1 time: 0.084531 Aug 12 07:00:42.988524 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 569/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:42 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:00:44.013322 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:44.013972 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] [instance: 397bc232-8dd0-4925-89b3-7f2cd5a06dd5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:00:44.022380 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:44.022855 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:44.023320 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:44.024005 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:00:44.024454 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:00:44.024863 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:00:44.044888 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] HTTP exception thrown: Instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 could not be found. Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Request method failure captured: Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 HTTP/1.1 Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fmJ84ihi6Z17bALjnKCmRn4SgBhb3gGeGUmZvulsZffMrDlDMe9WYrxRQzvbLEQQrZZF9ONcki9BE1DPex86wpd6vCJtYp2razPMaYWb-8xY6mSaavtaiwukjvVPp0SgzXdMked_DXDxeHaLj5oyGA2kfx6SjbJmzN_fpaIClBqndg Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 8139d6fef5384619a46f4b7f2095a565 Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-TestShelveInstance-1805542159 Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 07:00:44.046568 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8139d6fef5384619a46f4b7f2095a565", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8139d6fef5384619a46f4b7f2095a565"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8139d6fef5384619a46f4b7f2095a565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8139d6fef5384619a46f4b7f2095a565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-TestShelveInstance-1805542159 Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 8139d6fef5384619a46f4b7f2095a565 Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-TestShelveInstance-1805542159 Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-TestShelveInstance-1805542159-project Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 7450a2c6c0364245a9e609577e82859d Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-TestShelveInstance-1805542159-project Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 could not be found. Aug 12 07:00:44.048452 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '397bc232-8dd0-4925-89b3-7f2cd5a06dd5'} Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 could not be found. Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 07:00:44.049627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 could not be found. Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 could not be found. Aug 12 07:00:44.051353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 07:00:44.052861 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Returning 404 to user: Instance 397bc232-8dd0-4925-89b3-7f2cd5a06dd5 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 07:00:44.052861 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b1ea6151-77a6-4eac-9f7c-e3428d059572 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5" status: 404 len: 111 microversion: 2.1 time: 0.041463 Aug 12 07:00:44.052861 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 538/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:00:44 2022] GET /compute/v2.1/servers/397bc232-8dd0-4925-89b3-7f2cd5a06dd5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 07:00:44.230268 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4604a406-8c47-4a89-9acd-ff57573d6ea7 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] Calling method '.version_select at 0x7fc705a86670>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:00:44.258099 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4604a406-8c47-4a89-9acd-ff57573d6ea7 tempest-TestShelveInstance-1805542159 tempest-TestShelveInstance-1805542159-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-348499657" status: 202 len: 0 microversion: 2.1 time: 0.031500 Aug 12 07:00:44.259260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 570/1108] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 07:00:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-348499657 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 07:02:02.822121 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 07:02:02.822967 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=56 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 07:02:02.826785 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 07:02:02.827909 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3542a6cd-a947-4019-9d9f-c2614b797050 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:02.828401 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3542a6cd-a947-4019-9d9f-c2614b797050 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:02.828528 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 07:02:02.832876 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-5858c388-4b80-4dfa-a54e-52da99d94de1 req-ed25b23b-a492-4212-ace8-303314761ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a55f44-2ecd-4150-899b-3dfa1b973e30", "tag": "0631d29c-428e-4013-8268-2037d9e76cef"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 07:02:02.836409 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3542a6cd-a947-4019-9d9f-c2614b797050 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:02.837013 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3542a6cd-a947-4019-9d9f-c2614b797050 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:02.837662 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3542a6cd-a947-4019-9d9f-c2614b797050 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:02.838562 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3542a6cd-a947-4019-9d9f-c2614b797050 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:02.839225 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3542a6cd-a947-4019-9d9f-c2614b797050 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:02.839857 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3542a6cd-a947-4019-9d9f-c2614b797050 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:02.849301 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-5858c388-4b80-4dfa-a54e-52da99d94de1 req-ed25b23b-a492-4212-ace8-303314761ee1 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:02.849915 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-5858c388-4b80-4dfa-a54e-52da99d94de1 req-ed25b23b-a492-4212-ace8-303314761ee1 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:02.850444 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-5858c388-4b80-4dfa-a54e-52da99d94de1 req-ed25b23b-a492-4212-ace8-303314761ee1 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:02.864144 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-5858c388-4b80-4dfa-a54e-52da99d94de1 req-ed25b23b-a492-4212-ace8-303314761ee1 service nova] Creating event network-changed:0631d29c-428e-4013-8268-2037d9e76cef for instance 86a55f44-2ecd-4150-899b-3dfa1b973e30 on hv-cinder-84457 Aug 12 07:02:02.869862 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-5858c388-4b80-4dfa-a54e-52da99d94de1 req-ed25b23b-a492-4212-ace8-303314761ee1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045326 Aug 12 07:02:02.870598 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 571/1109] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 07:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 07:02:02.874628 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3542a6cd-a947-4019-9d9f-c2614b797050 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 07:02:02.960456 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3542a6cd-a947-4019-9d9f-c2614b797050 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "DELETE /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 204 len: 0 microversion: 2.1 time: 0.140035 Aug 12 07:02:02.965670 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 539/1110] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 07:02:02 2022] DELETE /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 07:02:02.972932 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8bb3f11c-ffdc-4c4d-bfa0-cf296c914e1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:02.973699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8bb3f11c-ffdc-4c4d-bfa0-cf296c914e1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:02.980212 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bb3f11c-ffdc-4c4d-bfa0-cf296c914e1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:02.980759 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bb3f11c-ffdc-4c4d-bfa0-cf296c914e1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:02.981271 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bb3f11c-ffdc-4c4d-bfa0-cf296c914e1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:02.982018 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bb3f11c-ffdc-4c4d-bfa0-cf296c914e1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:02.982540 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bb3f11c-ffdc-4c4d-bfa0-cf296c914e1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:02.982955 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bb3f11c-ffdc-4c4d-bfa0-cf296c914e1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:03.119136 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8bb3f11c-ffdc-4c4d-bfa0-cf296c914e1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:02:03.127237 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8bb3f11c-ffdc-4c4d-bfa0-cf296c914e1d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1575 microversion: 2.1 time: 0.159855 Aug 12 07:02:03.127902 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 572/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:02:02 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 07:02:04.152437 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8fcfdf49-f2e7-42bf-ac53-8e5deb90dbbb tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:04.153222 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8fcfdf49-f2e7-42bf-ac53-8e5deb90dbbb tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:04.160406 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fcfdf49-f2e7-42bf-ac53-8e5deb90dbbb tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:04.160893 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fcfdf49-f2e7-42bf-ac53-8e5deb90dbbb tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:04.161330 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fcfdf49-f2e7-42bf-ac53-8e5deb90dbbb tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:04.162031 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fcfdf49-f2e7-42bf-ac53-8e5deb90dbbb tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:04.162486 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fcfdf49-f2e7-42bf-ac53-8e5deb90dbbb tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:04.162895 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8fcfdf49-f2e7-42bf-ac53-8e5deb90dbbb tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:04.305173 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8fcfdf49-f2e7-42bf-ac53-8e5deb90dbbb tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:02:04.313612 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8fcfdf49-f2e7-42bf-ac53-8e5deb90dbbb tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1575 microversion: 2.1 time: 0.168183 Aug 12 07:02:04.314206 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 540/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:02:04 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:02:05.335086 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-970a3fe8-a262-4c94-9f9b-29468bf1b6f0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:05.335645 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-970a3fe8-a262-4c94-9f9b-29468bf1b6f0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:05.341708 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-970a3fe8-a262-4c94-9f9b-29468bf1b6f0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:05.342184 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-970a3fe8-a262-4c94-9f9b-29468bf1b6f0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:05.342617 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-970a3fe8-a262-4c94-9f9b-29468bf1b6f0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:05.343341 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-970a3fe8-a262-4c94-9f9b-29468bf1b6f0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:05.343947 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-970a3fe8-a262-4c94-9f9b-29468bf1b6f0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:05.344365 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-970a3fe8-a262-4c94-9f9b-29468bf1b6f0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:05.377152 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-beb1ae11-6067-4936-883f-6e99f3af6033 req-8529b267-78c8-437a-90c0-7de992e5d2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a55f44-2ecd-4150-899b-3dfa1b973e30", "name": "network-vif-deleted", "tag": "0631d29c-428e-4013-8268-2037d9e76cef"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 07:02:05.387201 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-beb1ae11-6067-4936-883f-6e99f3af6033 req-8529b267-78c8-437a-90c0-7de992e5d2ee service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:05.387713 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-beb1ae11-6067-4936-883f-6e99f3af6033 req-8529b267-78c8-437a-90c0-7de992e5d2ee service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:05.388230 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-beb1ae11-6067-4936-883f-6e99f3af6033 req-8529b267-78c8-437a-90c0-7de992e5d2ee service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:05.408409 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-beb1ae11-6067-4936-883f-6e99f3af6033 req-8529b267-78c8-437a-90c0-7de992e5d2ee service nova] Creating event network-vif-deleted:0631d29c-428e-4013-8268-2037d9e76cef for instance 86a55f44-2ecd-4150-899b-3dfa1b973e30 on hv-cinder-84457 Aug 12 07:02:05.414391 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-beb1ae11-6067-4936-883f-6e99f3af6033 req-8529b267-78c8-437a-90c0-7de992e5d2ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040572 Aug 12 07:02:05.415076 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 541/1113] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 07:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 07:02:05.416452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-970a3fe8-a262-4c94-9f9b-29468bf1b6f0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:02:05.424167 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-970a3fe8-a262-4c94-9f9b-29468bf1b6f0 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1389 microversion: 2.1 time: 0.093134 Aug 12 07:02:05.424724 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 573/1114] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:02:05 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:02:06.446815 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:06.447557 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:06.454078 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:06.454662 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:06.455120 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:06.455821 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:06.456271 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:06.456689 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:06.488394 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:06.488869 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:06.489308 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:06.489736 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lazy-loading 'fault' on Instance uuid 86a55f44-2ecd-4150-899b-3dfa1b973e30 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 07:02:06.533627 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:02:06.540818 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ff9b08af-b72c-42b9-82bc-88167e92a10c tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 200 len: 1182 microversion: 2.1 time: 0.098887 Aug 12 07:02:06.541418 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 542/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:02:06 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 1182 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:02:07.562313 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:07.562901 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a55f44-2ecd-4150-899b-3dfa1b973e30] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:07.569934 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:07.570399 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:07.570830 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:07.571569 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:07.572014 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:07.572425 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:07.586195 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] HTTP exception thrown: Instance 86a55f44-2ecd-4150-899b-3dfa1b973e30 could not be found. Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Request method failure captured: Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 HTTP/1.1 Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9fldNnheDuqto9f8GrufaZ6yGBiqB3Gvc_LnV5CZ3Wv-f_rurzDTfUHqyQUQjMmTi56kA9zobZ7pCtfCmzHpy22fmpjgSoaP3Z7MPH386hXOrgkHVV7evHsV3nA53eB0-41x_sfDc1nUVGCRBF9vPa4aEjj75boJPvfqr8CeFfJ2D_Y Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 64466d34729c44908afad2679c99d439 Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 07:02:07.587979 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64466d34729c44908afad2679c99d439", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64466d34729c44908afad2679c99d439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64466d34729c44908afad2679c99d439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64466d34729c44908afad2679c99d439"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 64466d34729c44908afad2679c99d439 Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-TestVolumeBootPattern-1372693688-project Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 5138389f1535438d8380cf6cc9bd891b Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestVolumeBootPattern-1372693688-project Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 86a55f44-2ecd-4150-899b-3dfa1b973e30 could not be found. Aug 12 07:02:07.589768 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '86a55f44-2ecd-4150-899b-3dfa1b973e30'} Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a55f44-2ecd-4150-899b-3dfa1b973e30 could not be found. Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 07:02:07.590699 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a55f44-2ecd-4150-899b-3dfa1b973e30 could not be found. Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a55f44-2ecd-4150-899b-3dfa1b973e30 could not be found. Aug 12 07:02:07.592163 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:07.594036 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Returning 404 to user: Instance 86a55f44-2ecd-4150-899b-3dfa1b973e30 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 07:02:07.594036 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-47d61f86-36da-4267-8f1b-d95db43ab276 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30" status: 404 len: 111 microversion: 2.1 time: 0.031018 Aug 12 07:02:07.594036 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 574/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:02:07 2022] GET /compute/v2.1/servers/86a55f44-2ecd-4150-899b-3dfa1b973e30 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 07:02:10.697708 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ff77472f-afdd-400f-b1db-64a176de8bf5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:10.698269 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ff77472f-afdd-400f-b1db-64a176de8bf5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:10.699935 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-fddc77b0-960f-438e-9ac0-4bdeae91df66 req-e7a623e2-ec7e-4e39-8a94-b0f97542a0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217dedfb-803a-4cca-8170-2b381b9bc4a9", "tag": "4bab8d1c-fe10-44f2-b00b-23441af1c226"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 07:02:10.704883 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff77472f-afdd-400f-b1db-64a176de8bf5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:10.705353 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff77472f-afdd-400f-b1db-64a176de8bf5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:10.705999 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff77472f-afdd-400f-b1db-64a176de8bf5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:10.706732 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff77472f-afdd-400f-b1db-64a176de8bf5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:10.707214 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff77472f-afdd-400f-b1db-64a176de8bf5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:10.707631 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff77472f-afdd-400f-b1db-64a176de8bf5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:10.709627 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fddc77b0-960f-438e-9ac0-4bdeae91df66 req-e7a623e2-ec7e-4e39-8a94-b0f97542a0e4 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:10.710102 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fddc77b0-960f-438e-9ac0-4bdeae91df66 req-e7a623e2-ec7e-4e39-8a94-b0f97542a0e4 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:10.710540 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fddc77b0-960f-438e-9ac0-4bdeae91df66 req-e7a623e2-ec7e-4e39-8a94-b0f97542a0e4 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:10.722223 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-fddc77b0-960f-438e-9ac0-4bdeae91df66 req-e7a623e2-ec7e-4e39-8a94-b0f97542a0e4 service nova] Creating event network-changed:4bab8d1c-fe10-44f2-b00b-23441af1c226 for instance 217dedfb-803a-4cca-8170-2b381b9bc4a9 on hv-cinder-84457 Aug 12 07:02:10.728632 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-fddc77b0-960f-438e-9ac0-4bdeae91df66 req-e7a623e2-ec7e-4e39-8a94-b0f97542a0e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032139 Aug 12 07:02:10.729230 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 575/1117] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 07:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 07:02:10.736179 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ff77472f-afdd-400f-b1db-64a176de8bf5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 07:02:10.833199 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ff77472f-afdd-400f-b1db-64a176de8bf5 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "DELETE /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 204 len: 0 microversion: 2.1 time: 0.139236 Aug 12 07:02:10.834009 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 543/1118] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 07:02:10 2022] DELETE /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 07:02:10.842489 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-998925db-ec31-437b-8752-8cba9c3e4c35 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:10.843211 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-998925db-ec31-437b-8752-8cba9c3e4c35 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:10.849802 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-998925db-ec31-437b-8752-8cba9c3e4c35 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:10.850290 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-998925db-ec31-437b-8752-8cba9c3e4c35 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:10.850713 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-998925db-ec31-437b-8752-8cba9c3e4c35 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:10.851458 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-998925db-ec31-437b-8752-8cba9c3e4c35 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:10.852103 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-998925db-ec31-437b-8752-8cba9c3e4c35 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:10.852502 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-998925db-ec31-437b-8752-8cba9c3e4c35 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:11.014867 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-998925db-ec31-437b-8752-8cba9c3e4c35 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:02:11.023565 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-998925db-ec31-437b-8752-8cba9c3e4c35 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1576 microversion: 2.1 time: 0.185159 Aug 12 07:02:11.024197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 576/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:02:10 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:02:12.046267 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-314d5d07-bfcf-4766-945c-a3258a750c89 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:12.046962 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-314d5d07-bfcf-4766-945c-a3258a750c89 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:12.053769 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-314d5d07-bfcf-4766-945c-a3258a750c89 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:12.054246 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-314d5d07-bfcf-4766-945c-a3258a750c89 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:12.054669 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-314d5d07-bfcf-4766-945c-a3258a750c89 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:12.055684 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-314d5d07-bfcf-4766-945c-a3258a750c89 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:12.056126 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-314d5d07-bfcf-4766-945c-a3258a750c89 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:12.056540 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-314d5d07-bfcf-4766-945c-a3258a750c89 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:12.233944 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-314d5d07-bfcf-4766-945c-a3258a750c89 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:02:12.241955 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-314d5d07-bfcf-4766-945c-a3258a750c89 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1576 microversion: 2.1 time: 0.199948 Aug 12 07:02:12.242498 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 544/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:02:12 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:02:13.155166 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-bd3dfd7f-3afd-4aba-9840-bbf36a0f5c59 req-3d389661-df36-467b-bf0a-1826fbc14877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217dedfb-803a-4cca-8170-2b381b9bc4a9", "name": "network-vif-deleted", "tag": "4bab8d1c-fe10-44f2-b00b-23441af1c226"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 07:02:13.165283 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bd3dfd7f-3afd-4aba-9840-bbf36a0f5c59 req-3d389661-df36-467b-bf0a-1826fbc14877 service nova] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:13.165777 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bd3dfd7f-3afd-4aba-9840-bbf36a0f5c59 req-3d389661-df36-467b-bf0a-1826fbc14877 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:13.166199 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bd3dfd7f-3afd-4aba-9840-bbf36a0f5c59 req-3d389661-df36-467b-bf0a-1826fbc14877 service nova] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:13.177672 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-bd3dfd7f-3afd-4aba-9840-bbf36a0f5c59 req-3d389661-df36-467b-bf0a-1826fbc14877 service nova] Creating event network-vif-deleted:4bab8d1c-fe10-44f2-b00b-23441af1c226 for instance 217dedfb-803a-4cca-8170-2b381b9bc4a9 on hv-cinder-84457 Aug 12 07:02:13.182705 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-bd3dfd7f-3afd-4aba-9840-bbf36a0f5c59 req-3d389661-df36-467b-bf0a-1826fbc14877 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031144 Aug 12 07:02:13.183337 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 577/1121] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 07:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 07:02:13.262683 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1f81507e-bd35-4c3c-8a02-c53a55d3b84a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:13.263301 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1f81507e-bd35-4c3c-8a02-c53a55d3b84a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:13.270966 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f81507e-bd35-4c3c-8a02-c53a55d3b84a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:13.271483 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f81507e-bd35-4c3c-8a02-c53a55d3b84a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:13.271904 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f81507e-bd35-4c3c-8a02-c53a55d3b84a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:13.272618 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f81507e-bd35-4c3c-8a02-c53a55d3b84a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:13.273066 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f81507e-bd35-4c3c-8a02-c53a55d3b84a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:13.273480 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f81507e-bd35-4c3c-8a02-c53a55d3b84a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:13.339129 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1f81507e-bd35-4c3c-8a02-c53a55d3b84a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5138389f1535438d8380cf6cc9bd891b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64466d34729c44908afad2679c99d439', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 07:02:13.347266 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1f81507e-bd35-4c3c-8a02-c53a55d3b84a tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 200 len: 1225 microversion: 2.1 time: 0.088452 Aug 12 07:02:13.347775 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 545/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:02:13 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 07:02:14.369745 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:14.370477 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 217dedfb-803a-4cca-8170-2b381b9bc4a9] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:14.377426 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:14.377908 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:14.378368 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:14.379204 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:14.379656 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:14.380096 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:14.394117 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] HTTP exception thrown: Instance 217dedfb-803a-4cca-8170-2b381b9bc4a9 could not be found. Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Request method failure captured: Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 HTTP/1.1 Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9fldNnheDuqto9f8GrufaZ6yGBiqB3Gvc_LnV5CZ3Wv-f_rurzDTfUHqyQUQjMmTi56kA9zobZ7pCtfCmzHpy22fmpjgSoaP3Z7MPH386hXOrgkHVV7evHsV3nA53eB0-41x_sfDc1nUVGCRBF9vPa4aEjj75boJPvfqr8CeFfJ2D_Y Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 64466d34729c44908afad2679c99d439 Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 07:02:14.395780 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64466d34729c44908afad2679c99d439", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64466d34729c44908afad2679c99d439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64466d34729c44908afad2679c99d439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64466d34729c44908afad2679c99d439"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 64466d34729c44908afad2679c99d439 Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-TestVolumeBootPattern-1372693688-project Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 5138389f1535438d8380cf6cc9bd891b Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestVolumeBootPattern-1372693688-project Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 217dedfb-803a-4cca-8170-2b381b9bc4a9 could not be found. Aug 12 07:02:14.397743 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '217dedfb-803a-4cca-8170-2b381b9bc4a9'} Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217dedfb-803a-4cca-8170-2b381b9bc4a9 could not be found. Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 07:02:14.398779 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217dedfb-803a-4cca-8170-2b381b9bc4a9 could not be found. Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217dedfb-803a-4cca-8170-2b381b9bc4a9 could not be found. Aug 12 07:02:14.400246 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.401773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Returning 404 to user: Instance 217dedfb-803a-4cca-8170-2b381b9bc4a9 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 07:02:14.401773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6cba3e6e-5f04-4545-9150-933187044dea tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9" status: 404 len: 111 microversion: 2.1 time: 0.032375 Aug 12 07:02:14.401773 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 578/1123] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:02:14 2022] GET /compute/v2.1/servers/217dedfb-803a-4cca-8170-2b381b9bc4a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 07:02:14.844708 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:14.845250 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:14.851802 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:14.852272 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:14.852697 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:14.853379 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:14.853830 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:14.854243 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:14.867506 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] HTTP exception thrown: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Request method failure captured: Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 HTTP/1.1 Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept: application/json Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Connection: close Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Length: 0 Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Content-Type: application/json Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Host: 10.222.0.20 Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.11 Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABi9fldNnheDuqto9f8GrufaZ6yGBiqB3Gvc_LnV5CZ3Wv-f_rurzDTfUHqyQUQjMmTi56kA9zobZ7pCtfCmzHpy22fmpjgSoaP3Z7MPH386hXOrgkHVV7evHsV3nA53eB0-41x_sfDc1nUVGCRBF9vPa4aEjj75boJPvfqr8CeFfJ2D_Y Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Id: 64466d34729c44908afad2679c99d439 Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Role: reader,member Aug 12 07:02:14.869153 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64466d34729c44908afad2679c99d439", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64466d34729c44908afad2679c99d439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64466d34729c44908afad2679c99d439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64466d34729c44908afad2679c99d439"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 64466d34729c44908afad2679c99d439 Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User: tempest-TestVolumeBootPattern-1372693688-project Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Id: 5138389f1535438d8380cf6cc9bd891b Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-TestVolumeBootPattern-1372693688-project Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: method: > Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: exception: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 07:02:14.870958 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: action_args: {'id': '86a9065d-a53f-4325-b7eb-a0aad221c075'} Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 07:02:14.872174 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 07:02:14.873828 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.875588 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Returning 404 to user: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 07:02:14.875588 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-83d2292b-f5b5-456a-974d-32fa3900aa7d tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "DELETE /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 404 len: 111 microversion: 2.1 time: 0.029821 Aug 12 07:02:14.875588 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 546/1124] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 07:02:14 2022] DELETE /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 07:02:14.879574 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:14.880197 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] [instance: 86a9065d-a53f-4325-b7eb-a0aad221c075] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 07:02:14.886260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:14.886731 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:14.887188 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:14.887866 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Acquiring lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 07:02:14.888308 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 07:02:14.888715 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Lock "5ed89e9f-13dd-4dd0-a4be-01d22fad866b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 07:02:14.902926 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] HTTP exception thrown: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Request method failure captured: Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 HTTP/1.1 Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Connection: close Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Host: 10.222.0.20 Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.11 Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABi9fldNnheDuqto9f8GrufaZ6yGBiqB3Gvc_LnV5CZ3Wv-f_rurzDTfUHqyQUQjMmTi56kA9zobZ7pCtfCmzHpy22fmpjgSoaP3Z7MPH386hXOrgkHVV7evHsV3nA53eB0-41x_sfDc1nUVGCRBF9vPa4aEjj75boJPvfqr8CeFfJ2D_Y Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Id: 64466d34729c44908afad2679c99d439 Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Role: reader,member Aug 12 07:02:14.904452 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64466d34729c44908afad2679c99d439", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64466d34729c44908afad2679c99d439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64466d34729c44908afad2679c99d439"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64466d34729c44908afad2679c99d439"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 64466d34729c44908afad2679c99d439 Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestVolumeBootPattern-1372693688 Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User: tempest-TestVolumeBootPattern-1372693688-project Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Id: 5138389f1535438d8380cf6cc9bd891b Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestVolumeBootPattern-1372693688-project Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: method: > Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: exception: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 07:02:14.906266 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: action_args: {'id': '86a9065d-a53f-4325-b7eb-a0aad221c075'} Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 07:02:14.907250 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. Aug 12 07:02:14.908809 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 12 07:02:14.910214 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Returning 404 to user: Instance 86a9065d-a53f-4325-b7eb-a0aad221c075 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 07:02:14.910214 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-63815994-e280-4111-91d3-61c1b6a5b2ad tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075" status: 404 len: 111 microversion: 2.1 time: 0.030454 Aug 12 07:02:14.910214 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 579/1125] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 07:02:14 2022] GET /compute/v2.1/servers/86a9065d-a53f-4325-b7eb-a0aad221c075 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 07:02:16.231422 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e916b049-f3d4-4c95-a412-278ff80a8f94 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] Calling method '.version_select at 0x7fc704741940>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 07:02:16.257439 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e916b049-f3d4-4c95-a412-278ff80a8f94 tempest-TestVolumeBootPattern-1372693688 tempest-TestVolumeBootPattern-1372693688-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-271553105" status: 202 len: 0 microversion: 2.1 time: 0.029802 Aug 12 07:02:16.258042 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 547/1126] 10.222.0.20 () {58 vars in 1260 bytes} [Fri Aug 12 07:02:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-271553105 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 07:03:03.478881 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 07:03:03.480514 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Fri Aug 12 07:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 07:03:19.186871 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 07:03:19.187546 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Fri Aug 12 07:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 07:04:36.095731 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 07:04:36.096869 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Fri Aug 12 07:04:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 07:04:37.100386 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 07:04:37.101302 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Fri Aug 12 07:04:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 07:04:54.218383 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 07:04:54.218939 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Fri Aug 12 07:04:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 07:05:12.072381 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 07:05:12.073260 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Fri Aug 12 07:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 07:06:23.496131 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 07:06:23.496888 dv-cinder-844572-2-iscsi devstack@n-api.service[127088]: Fri Aug 12 07:06:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 07:06:39.197065 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 07:06:39.197698 dv-cinder-844572-2-iscsi devstack@n-api.service[127087]: Fri Aug 12 07:06:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!